-- Logs begin at Thu 2022-06-23 16:13:44 UTC, end at Thu 2022-06-23 17:41:21 UTC. -- Jun 23 17:03:35.909986 dv-cinder-835384-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 17:03:35.919948 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 17:03:35.922515 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 17:03:35 2022] *** Jun 23 17:03:35.922515 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 17:03:35.922515 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 17:03:35.922515 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: nodename: dv-cinder-835384-10-iscsi Jun 23 17:03:35.922515 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: machine: x86_64 Jun 23 17:03:35.922515 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: clock source: unix Jun 23 17:03:35.922515 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: pcre jit disabled Jun 23 17:03:35.922515 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: detected number of CPU cores: 4 Jun 23 17:03:35.922515 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: current working directory: / Jun 23 17:03:35.922515 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: detected binary path: /usr/bin/uwsgi-core Jun 23 17:03:35.923178 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: your processes number limit is 47680 Jun 23 17:03:35.923178 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: your memory page size is 4096 bytes Jun 23 17:03:35.923178 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: detected max file descriptor number: 2048 Jun 23 17:03:35.923178 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: lock engine: pthread robust mutexes Jun 23 17:03:35.923178 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: thunder lock: enabled Jun 23 17:03:35.923178 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 17:03:35.923178 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 17:03:35.966610 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: Python main interpreter initialized at 0x560f746059c0 Jun 23 17:03:35.966610 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: python threads support enabled Jun 23 17:03:35.966610 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: your server socket listen backlog is limited to 100 connections Jun 23 17:03:35.966610 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: your mercy for graceful operations on workers is 90 seconds Jun 23 17:03:35.966959 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 17:03:35.966959 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: *** Operational MODE: preforking *** Jun 23 17:03:35.967215 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: *** uWSGI is running in multiple interpreter mode *** Jun 23 17:03:35.967215 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: spawned uWSGI master process (pid: 103375) Jun 23 17:03:35.967428 dv-cinder-835384-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 17:03:35.970041 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: spawned uWSGI worker 1 (pid: 103376, cores: 1) Jun 23 17:03:35.970041 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: spawned uWSGI worker 2 (pid: 103377, cores: 1) Jun 23 17:03:35.970041 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 17:03:36.623144 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 17:03:36.623828 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 17:03:37.735198 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 17:03:37.735198 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: from cryptography.utils import int_from_bytes Jun 23 17:03:37.735776 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 17:03:37.735776 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: from cryptography.utils import int_from_bytes Jun 23 17:03:37.736160 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 17:03:37.736160 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: from cryptography.utils import int_from_bytes Jun 23 17:03:37.736285 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 17:03:37.736285 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: from cryptography.utils import int_from_bytes Jun 23 17:03:40.199705 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 17:03:40.200444 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 17:03:40.200811 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 17:03:40.200884 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 17:03:40.200951 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 17:03:40.201016 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 17:03:40.201087 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 17:03:40.201171 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 17:03:40.201245 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 17:03:40.201324 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 17:03:40.201399 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.201466 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.201701 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.201816 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.202029 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.202184 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.202347 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.202446 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.202705 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.202836 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.202974 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.203064 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.203324 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.203465 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.203635 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.203774 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.203961 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.204105 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.204206 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.204275 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.204492 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.204596 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.204833 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-10-iscsi {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.204963 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-10-iscsi {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.205154 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.205285 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.205453 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.205584 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.205762 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.206128 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.206128 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.206360 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.206483 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.206566 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.206690 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.206795 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.207014 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.207153 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.207507 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.207661 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.207925 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.208051 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.208227 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.208341 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.208530 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.208649 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.208861 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.208975 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.209167 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.209269 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.209469 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.209569 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.209782 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.209890 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.210111 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.210207 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.210427 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.210515 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.210729 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.210822 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.211120 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-10-iscsi {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.211219 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-10-iscsi {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.211433 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.211529 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.211741 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.211836 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.212053 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.212147 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.212452 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.212584 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.212748 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.212821 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.213034 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.213141 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.213367 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.213533 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.213680 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.213770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.214004 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.214105 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.214329 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.214431 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.214641 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.214729 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.214952 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.215041 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.215264 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.215359 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.215563 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.215658 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.215864 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.215952 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.216165 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.216261 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.216457 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.216542 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.216756 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.216839 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.217052 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.217137 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.217299 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.217384 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.217599 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.217691 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.217938 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.218028 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.218253 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.218350 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.218568 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.218664 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.218814 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.218898 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.219058 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.219142 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.219370 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.219455 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.219684 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.219776 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.219985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.220080 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.220285 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.220370 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.220586 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.220669 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.220883 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.220974 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.221180 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.221267 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.221498 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.221668 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.221884 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.221986 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.222189 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.222408 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.222494 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.222733 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.222822 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.223048 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.223142 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.223369 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.223454 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.223675 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.223760 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.223993 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.224092 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.224299 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.224383 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.224604 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.224689 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.224912 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.225004 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.225236 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.225331 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.225539 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.225634 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.225866 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.225965 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.226182 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.226278 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.226483 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.226577 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.226784 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.226876 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.227084 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.227171 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.227381 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.227478 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.227697 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.227783 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.227998 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.228082 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.228245 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.228340 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.228541 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.228628 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.228925 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.229020 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.229137 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.229223 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.229434 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.229517 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.229736 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.229869 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.230059 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.230145 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.230354 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.230447 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.230647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.230731 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.230945 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.231031 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.231243 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.231327 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.231541 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.231626 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.231839 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.231933 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.232137 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.232221 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.232433 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.232523 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.232733 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.232821 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.233031 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.233122 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.233332 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.233430 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.233643 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.233727 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.233966 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.234053 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.234267 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.234365 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.234566 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.234652 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.234865 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.234949 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.235169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.235261 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.235468 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.235561 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.235767 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.235853 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.236065 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.236159 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.236367 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.236452 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.236668 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.236751 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.236968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.237061 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.237348 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.237432 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.237656 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.237743 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.237993 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.238095 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.238294 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.238381 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.238594 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.238678 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.238897 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.239066 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.239197 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.239281 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.239498 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.239591 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.239797 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.239892 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.240094 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.240187 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.240391 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.240476 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.240690 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.240774 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.240986 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.241071 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.241282 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.241365 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.241582 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.241667 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.241901 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.242001 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.242217 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.242302 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.242519 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.242604 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.242821 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.242908 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.243121 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.243205 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.243419 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.243512 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.243732 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:03:40.243825 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.244063 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.244157 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.244391 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.244483 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.244701 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.244784 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.245030 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.245122 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.245357 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.245447 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.245672 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.245757 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.246006 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.246109 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.246313 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.246397 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.246625 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.246710 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.246932 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.247017 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.247242 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.247327 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.247549 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.247640 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.247860 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.247946 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.248171 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.248255 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.248483 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.248576 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.248798 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.248890 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.249109 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.249201 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.249423 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.249507 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.249727 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.249901 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.250060 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.250146 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.250375 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.250467 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.250691 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.250776 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.250997 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.251082 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.251302 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.251393 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.251639 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.251724 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.251956 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.252048 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.252271 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.252371 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.252585 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.252669 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.252993 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.253132 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.253297 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.253437 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.253602 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.253699 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.253935 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.254024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.254256 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.254352 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.254563 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.254667 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.254877 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.254961 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.255184 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.255277 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.255492 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.255576 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.255801 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.255925 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.256112 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.256217 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.256414 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.256516 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.256718 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.256802 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.257038 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.257125 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.257347 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.257431 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.257653 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.257737 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.257984 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.258079 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.258299 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.258384 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.258602 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.258688 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.258908 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.259003 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.259211 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.259304 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.259512 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.259602 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.259812 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.259906 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.260115 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.260200 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.260413 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.260515 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.260712 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.260796 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.261028 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.261113 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.261332 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.261496 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.261641 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.261733 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.261976 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.262076 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.262284 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.262382 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.262590 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.262674 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.262895 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.262979 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.263199 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.263303 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.263499 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.263583 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.263803 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.263895 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.264105 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.264192 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.264406 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.264491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.264720 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.264805 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.265022 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.265117 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.265321 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.265405 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.265630 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.265717 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.265956 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.266042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.266259 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.266343 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.266565 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.266662 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.266871 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.266956 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.267176 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.267259 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.267482 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.267574 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.267791 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.267876 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.268097 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.268181 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.268426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.268560 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.268736 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.268979 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.269070 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.269159 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.269383 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.269479 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.269684 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.269777 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.270030 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.270116 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.270344 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.270446 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.270647 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.270733 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.270945 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.271037 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.271247 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.271345 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.271548 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.271674 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.271847 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.271932 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.272143 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.272229 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.272441 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.272532 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.272737 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.272821 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.273035 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.273129 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.273334 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.273430 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.273631 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.273715 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.273951 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.274040 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.274269 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.274367 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.274569 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.274663 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.274869 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.275016 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.275167 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.275260 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.275465 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.275560 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.275789 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.275875 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.276088 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.276172 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.276421 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.276515 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.276742 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.276827 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.277054 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.277138 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.277358 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.277454 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.277664 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.277749 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.277992 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.278079 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.278297 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.278391 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.278601 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.278685 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.278904 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.278988 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.279211 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.279298 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.279514 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.279597 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.279817 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.279901 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.280119 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.280205 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.280421 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.280505 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.280732 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.280825 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.281034 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.281119 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.281335 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.281419 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.281640 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.281759 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.281988 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.282086 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.282313 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.282405 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.282626 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.282725 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.282938 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.283032 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.283240 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.283324 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.283549 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.283655 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.283850 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.283936 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.284202 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.284297 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.284510 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.284611 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.284819 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.284905 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.285125 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.285211 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.285429 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.285523 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.285735 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.285869 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.286066 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.286151 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.286372 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.286469 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.286678 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.286763 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.286985 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.287069 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.287284 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.287378 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.287586 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.287680 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.287897 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.287987 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.288222 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.288309 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.288529 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.288614 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.288837 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.288922 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.289143 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.289229 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.289448 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.289533 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.289753 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.289858 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.290085 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.290181 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.290386 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.290472 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.290686 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.290782 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.290986 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.291072 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.291293 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.291387 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.291604 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.291699 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.291980 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.292088 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.292212 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.292336 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.292514 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.292773 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.292863 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.293088 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.293175 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.293393 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.293487 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.293692 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.293819 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.294021 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.294106 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.294339 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.294437 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.294647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.294731 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.294962 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.295045 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.295279 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.295376 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.295583 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.295669 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.295883 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.295968 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.296200 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.296293 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.296505 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.296589 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.296807 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.296898 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.297104 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.297196 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.297401 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.297498 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.297738 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.297852 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.298071 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.298159 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.298370 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.298455 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.298683 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.298803 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.299000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.299086 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.299303 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.299387 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.299626 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.299711 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.299938 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.300074 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.300331 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.300416 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.300653 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.300738 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.300966 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.301060 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.301277 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.301362 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.301587 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.301680 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.301918 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.302006 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.302229 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.302313 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.302536 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.302632 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.302855 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.302946 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.303161 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.303257 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.303466 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.303558 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.303773 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.303867 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.304070 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.304161 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.304376 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.304469 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.304688 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.304779 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.305258 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.305350 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.305593 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.305679 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.305929 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.306030 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.306250 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.306334 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.306567 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.306653 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.306882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.306975 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.307211 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.307296 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.307533 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.307619 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.307874 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.307972 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.308178 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.308271 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.308485 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.308569 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.308788 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.308880 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.309091 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.309175 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.309403 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.309486 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.309705 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.309809 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.310031 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.310117 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.310334 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.310428 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.310643 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.310729 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.310941 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.311025 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.311243 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.311328 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.311542 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.311635 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.311843 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.311935 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.312155 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.312248 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.312454 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.312538 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.312761 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.312854 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.313063 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.313155 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.313379 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.313463 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.313684 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.313770 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.314012 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.314189 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.314314 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.314398 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.314611 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.314696 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.314951 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.315046 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.315324 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.315410 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.315661 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.315798 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.315989 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.316119 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.316327 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.316459 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.316631 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.316766 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.316936 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.317073 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.317257 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.317398 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.317561 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.317702 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.317885 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.318033 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.318188 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.318336 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.318495 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.318646 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.318806 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.318957 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.319105 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.319261 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.319412 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.319570 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.319720 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.319878 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.320030 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.320186 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.320336 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.320494 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.320635 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.320795 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.320944 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.321103 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.321245 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.321404 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.321559 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.321714 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.321888 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.322046 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.322190 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.322348 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.322831 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.322994 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.323142 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.323307 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.323449 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.323613 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.323747 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.323915 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.324041 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.324223 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.324342 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.324525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.324656 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.324846 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.324958 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.325152 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.325251 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.325455 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.325541 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.325755 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.325875 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.326088 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.326228 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.326396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.326482 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.326695 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.326781 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.327016 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.327102 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.327327 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.327413 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.327625 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.327710 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.327927 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.328020 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.328224 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.328309 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.328524 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.328610 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.328824 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.328910 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.329131 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.329223 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.329442 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.329528 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.329745 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.329909 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.330075 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.330172 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.330374 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.330467 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.330674 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.330767 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.331010 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.331096 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.331320 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.331419 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.331640 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.331736 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.331940 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.332034 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.332238 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.332333 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.332536 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.332631 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.332837 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.332931 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.333158 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.333252 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.333464 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.333549 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.333764 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.333909 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.334087 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.334178 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.334386 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.334479 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.334684 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.334779 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.335014 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.335100 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.335322 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.335446 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.335660 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.335745 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.335964 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.336051 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.336277 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.336362 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.336586 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.336680 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.336894 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.336980 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.337200 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.337292 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.337502 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.337600 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.337838 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.337926 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.338129 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.338215 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.338434 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.338527 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.338730 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.338815 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.339029 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.339122 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.339327 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.339419 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.339642 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.339726 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.339948 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.340032 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.340258 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.340352 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.340573 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.340657 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.340889 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.340981 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.341191 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.341289 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.341496 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.341588 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.341814 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.341902 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.342132 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.342219 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.342437 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.342521 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.342741 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.342832 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.343046 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.343133 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.343352 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.343436 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.343657 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.343743 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.343965 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.344097 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.344268 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.344363 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.344567 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.344652 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.344875 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.344961 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.345178 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.345264 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.345480 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.345573 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.345780 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.345898 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.346123 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.346209 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.346422 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.346567 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.346833 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.346920 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.347138 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.347418 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.347511 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.347734 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.347820 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.348049 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.348142 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.348357 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.348455 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.348743 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.348827 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.349044 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.349137 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.349354 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.349453 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.349660 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.349746 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.349994 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.350082 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.350306 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.350400 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.350608 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.350693 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.350920 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.351005 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.351224 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.351318 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.351618 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.351709 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.351928 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.352060 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.352233 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.352351 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.352535 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.352626 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.352834 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.352927 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.353137 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.353231 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.353438 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.353523 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.353738 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.353843 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.354062 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.354196 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.354362 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.354456 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.354664 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.354751 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.354977 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.355063 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.355277 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.355388 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.355598 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.355683 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.355984 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.356069 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.356303 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.356387 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.356608 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.356701 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.356983 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.357067 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.357300 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.357386 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.357606 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.357698 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.357948 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.358037 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.358252 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.358337 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.358563 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.358677 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.358864 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.358958 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.359175 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.359260 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.359484 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.359569 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.359791 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.359884 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.360103 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.360188 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.360406 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.360530 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.360718 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.360816 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.361021 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.361115 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.361333 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.361418 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.361650 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.361742 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.361997 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.362085 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.362393 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.362493 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.362757 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.362973 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.363070 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.363299 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.363386 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.363613 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.363707 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.363932 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.364019 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.364254 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.364340 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.364553 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.364642 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.364853 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.364948 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.365169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.365255 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.365469 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.365561 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.365768 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.365906 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.366097 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.366194 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.366399 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.366493 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.366701 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.366785 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.367000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.367086 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.367307 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.367393 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.367611 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.367739 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.367911 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.367997 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.368228 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.368328 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.368531 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.368616 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.368851 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.368945 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.369151 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.369236 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.369468 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.369552 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.369780 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.369894 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.370102 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.370189 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.370409 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.370497 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.370714 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.370810 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.371015 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.371100 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.371319 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.371405 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.371621 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.371716 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.371960 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.372053 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.372263 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.372362 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.372579 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.372672 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.372907 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.372992 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.373228 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.373313 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.373536 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.373630 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.373877 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.373967 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.374200 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.374286 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.374502 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.374591 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.374802 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.374887 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.375109 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.375204 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.375409 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.375495 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.375708 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.375838 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.376007 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.376102 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.376308 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.376402 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.376604 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.376689 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.376903 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.376998 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.377199 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.377290 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.377498 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.377583 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.377856 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.377985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.378153 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.378242 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.378472 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.378566 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.378772 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.378866 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.379073 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.379159 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.379373 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.379467 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.379671 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.379757 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.379975 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.380061 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.380273 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.380367 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.380610 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.380696 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.380907 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.380993 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.381236 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.381322 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.381544 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.381631 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.381886 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.381976 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.382203 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.382339 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.382511 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.382597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.382824 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.382917 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.383137 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.383232 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.383449 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.383542 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.383759 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.383844 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.384071 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.384166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.384380 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.384512 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.384692 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.384785 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.385004 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.385102 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.385312 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.385398 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.385625 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.385838 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.385967 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.386169 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.386286 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.386482 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.386794 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.386879 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.387106 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.387194 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.387417 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.387506 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.387724 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.387852 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.388029 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.388118 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.388338 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.388431 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.388642 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.388726 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.388948 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.389035 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.389258 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.389345 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.389563 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.389727 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.389888 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.390034 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.390208 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.390367 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.390529 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.390679 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.390853 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.390989 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.391184 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.391301 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.391497 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.391616 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.391809 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.391966 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.392120 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.392276 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.392433 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.392578 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.392787 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.392875 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.393097 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.393195 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.393479 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.393599 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.393807 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.393895 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.394122 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.394266 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.394430 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.394580 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.394740 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.394889 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.395055 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.395197 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.395365 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.395507 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.395674 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.395818 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.395982 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.396130 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.396290 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.396452 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.396598 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.396808 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.396978 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.397098 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.397217 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.397409 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.397548 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.397721 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.397889 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.398057 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.398203 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.398510 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.398595 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.398823 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.398945 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.399185 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.399332 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.399506 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.399648 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.399828 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.399981 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.400141 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.400305 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.400456 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.400627 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.400779 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.400940 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.401081 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.401257 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.401383 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.401613 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.401707 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.401947 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.402053 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.402254 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.402341 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.402565 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.402661 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.402879 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.402966 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.403182 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.403276 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.403496 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.403582 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.403801 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.403887 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.404101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.404331 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.404426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.404682 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.404768 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.405001 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.405229 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.405316 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.405575 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.405661 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.405914 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.406004 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.406240 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.406339 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.406563 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.406650 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.406875 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.407010 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.407175 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.407271 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.407486 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.407572 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.407786 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.407879 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.408087 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.408181 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.408391 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.408478 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.408694 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.408781 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.409021 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.409118 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.409325 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.409452 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.409766 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.409878 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.410090 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.410178 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.410409 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.410494 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.410710 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.410795 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.411010 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.411096 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.411310 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.411395 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.411618 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.411705 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.411919 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.412012 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.412217 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.412302 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.412518 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.412605 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.412817 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.412903 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.413117 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.413209 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.413413 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.413508 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.413713 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.413827 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.414035 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.414120 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.414340 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.414440 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.414641 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.414727 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.414947 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.415031 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.415255 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.415349 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.415558 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.415651 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.415866 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.415961 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.416166 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.416265 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.416479 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.416566 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.416787 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.416874 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.417098 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.417191 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.417403 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.417487 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.417710 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.417857 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.418053 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.418140 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.418362 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.418447 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.418671 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.418891 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.419015 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.419222 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.419332 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.419539 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.419854 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.419939 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.420183 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.420276 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.420488 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.420584 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.420788 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.420883 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.421088 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.421175 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.421410 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.421497 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.421713 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.421824 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.422062 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.422149 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.422369 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.422454 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.422680 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.422777 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.422985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.423070 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.423291 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.423378 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.423599 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.423693 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.423905 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.423990 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.424209 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.424294 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.424512 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.424689 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.424884 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.424984 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.425191 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.425278 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.425497 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.425585 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.425840 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.425931 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.426170 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.426268 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.426486 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.426588 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.426797 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.426883 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.427109 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.427208 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.427419 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.427506 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.427725 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.427818 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.428032 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.428133 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.428338 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.428426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.428644 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.428729 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.428951 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.429048 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.429256 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.429343 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.429566 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.429652 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.429895 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.429983 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.430222 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.430309 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.430538 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.430624 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.430872 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.430975 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.431228 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.431323 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.431539 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.431627 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.431854 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.431941 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.432173 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.432260 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.432481 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.432576 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.432801 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.432893 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.433108 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.433207 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.433416 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.433514 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.433736 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.433850 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.434070 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.434167 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.434398 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.434496 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.434702 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.434788 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.435009 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.435104 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.435314 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.435402 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.435623 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.435710 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.435940 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.436032 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.436246 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.436332 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.436547 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.436644 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.436850 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.436937 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.437155 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.437289 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.437455 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.437541 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.437753 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.437858 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.438078 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.438165 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.438381 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.438467 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.438684 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.438779 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.438983 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.439069 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.439283 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.439370 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.439585 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.439680 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.439884 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.439970 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.440184 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.440300 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.440518 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.440614 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.440826 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.441092 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.441178 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.441404 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.441497 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.441705 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.441808 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.442034 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.442131 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.442339 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.442434 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.442642 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.442728 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.442947 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.443041 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.443253 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.443348 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.443557 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.443643 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.443882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.443966 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.444201 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.444295 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.444508 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.444594 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.444827 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.444921 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.445135 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.445229 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.445446 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.445531 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.445754 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.445867 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.446099 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.446187 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.446406 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.446528 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.446714 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.446800 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.447021 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.447106 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.447324 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.447741 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.447972 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.448059 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.448284 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.448370 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.448592 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.448678 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.448898 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.448984 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.449206 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.449300 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.449516 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.449601 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.449906 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.450015 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.450178 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.450267 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.450481 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.450566 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.450790 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.450891 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.451107 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.451199 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.451415 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.451514 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.451725 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.451827 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.452032 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.452116 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.452340 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.452434 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.452648 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.452735 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.452957 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.453041 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.453273 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.453359 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.453583 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.453669 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.453915 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.454006 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.454232 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.454318 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.454549 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.454644 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.454871 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.454956 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.455194 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.455356 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.455507 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.455601 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.455848 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.455988 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.456239 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.456333 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.456554 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.456692 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.456865 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.456959 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.457169 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.457269 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.457408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 17:03:40.457532 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.457869 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.458182 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.458489 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:03:40.458730 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 17:03:40.615135 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO dbcounter [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] Registered counter for database nova_api Jun 23 17:03:40.615394 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO dbcounter [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] Registered counter for database nova_api Jun 23 17:03:40.636069 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG oslo_db.sqlalchemy.engines [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:03:40.639957 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_db.sqlalchemy.engines [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103376) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:03:40.644240 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writer thread running {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:03:40.647304 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writer thread running {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:03:40.701362 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.context [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d03b830d-8c4e-49e2-9a0f-91b2a277455e(cell1) {{(pid=103377) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 17:03:40.705267 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:03:40.705424 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.context [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d03b830d-8c4e-49e2-9a0f-91b2a277455e(cell1) {{(pid=103376) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 17:03:40.706932 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:03:40.707700 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:03:40.709350 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:03:40.709634 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG oslo_concurrency.lockutils [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103377) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:03:40.710977 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:03:40.711695 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO dbcounter [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] Registered counter for database nova_cell0 Jun 23 17:03:40.711827 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:03:40.713685 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:03:40.715702 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO dbcounter [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] Registered counter for database nova_cell0 Jun 23 17:03:40.715853 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO dbcounter [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] Registered counter for database nova_cell1 Jun 23 17:03:40.721500 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO dbcounter [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] Registered counter for database nova_cell1 Jun 23 17:03:40.724815 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG oslo_db.sqlalchemy.engines [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:03:40.726140 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG oslo_db.sqlalchemy.engines [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:03:40.727706 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_db.sqlalchemy.engines [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103376) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:03:40.731576 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_db.sqlalchemy.engines [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103376) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:03:40.733091 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writer thread running {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:03:40.733320 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writer thread running {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:03:40.734813 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writer thread running {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:03:40.873178 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writer thread running {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:03:40.877699 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO dbcounter [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] Registered counter for database nova_cell0 Jun 23 17:03:40.882097 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO dbcounter [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] Registered counter for database nova_cell0 Jun 23 17:03:40.887668 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG oslo_db.sqlalchemy.engines [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:03:40.892202 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_db.sqlalchemy.engines [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103376) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:03:40.893163 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writer thread running {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:03:40.898373 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writer thread running {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:03:41.224741 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: WARNING keystonemiddleware.auth_token [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 17:03:41.225946 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: WARNING keystonemiddleware.auth_token [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 17:03:41.232024 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: WARNING keystonemiddleware.auth_token [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 17:03:41.233183 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: WARNING keystonemiddleware.auth_token [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 17:03:41.573401 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: WARNING keystonemiddleware.auth_token [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 17:03:41.575290 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: WARNING keystonemiddleware.auth_token [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 17:03:41.579416 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: WARNING keystonemiddleware.auth_token [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 17:03:41.581225 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: WARNING keystonemiddleware.auth_token [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 17:03:41.584756 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560f746059c0 pid: 103377 (default app) Jun 23 17:03:41.586662 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560f746059c0 pid: 103376 (default app) Jun 23 17:03:41.586867 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:03:41.588059 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-e918bb54-a7ed-40b7-b8cd-fa6a5e2b953d None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 Jun 23 17:03:41.588472 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Thu Jun 23 17:03:41 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:04:56.871607 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:04:56.873468 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002628 Jun 23 17:04:56.876959 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 23 17:04:56 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:04:56.889525 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_api:SELECT=3 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:56.890604 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_cell1:SELECT=3 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:56.891833 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_cell0:SELECT=3 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:56.892550 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:57.327595 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-4ea86547-159c-4954-a21b-21c81276e78f admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:04:57.356739 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-4ea86547-159c-4954-a21b-21c81276e78f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.472682 Jun 23 17:04:57.357488 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1291 bytes} [Thu Jun 23 17:04:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:04:59.420440 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:04:59.421462 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-48fdaefe-4120-4672-af80-3d19fb8ebb12 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 23 17:04:59.422074 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 2/4] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 23 17:04:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:04:59.488935 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-6c436097-ff3f-44bb-9415-c772f6bac17b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "disk": 1, "swap": 0}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:04:59.507270 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:04:59.507270 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: warnings.warn(msg) Jun 23 17:04:59.539615 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-6c436097-ff3f-44bb-9415-c772f6bac17b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111621 Jun 23 17:04:59.540337 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 3/5] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 23 17:04:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 17:04:59.553878 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_api:SELECT=3 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:59.555024 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_cell0:SELECT=3 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:59.555971 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_cell1:SELECT=3 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:59.556675 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:59.760429 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-a6a240b9-42f4-4da7-b9ad-f98f88b8f018 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:04:59.762907 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:04:59.762907 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: warnings.warn(msg) Jun 23 17:04:59.825718 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-a6a240b9-42f4-4da7-b9ad-f98f88b8f018 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277073 Jun 23 17:04:59.826556 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 3/6] 10.222.0.18 () {64 vars in 1335 bytes} [Thu Jun 23 17:04:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:05:01.875937 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-6c436097-ff3f-44bb-9415-c772f6bac17b admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:01.876972 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-6c436097-ff3f-44bb-9415-c772f6bac17b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jun 23 17:05:01.877374 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 4/7] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 23 17:05:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:01.987946 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-dd72a3dd-d209-4f1d-8ad5-a29626c8ccf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:02.007941 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:05:02.007941 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: warnings.warn(msg) Jun 23 17:05:02.041509 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-dd72a3dd-d209-4f1d-8ad5-a29626c8ccf9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158022 Jun 23 17:05:02.042357 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 4/8] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 23 17:05:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 17:05:02.054031 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-2b444ba3-a017-49f9-bcb8-c02e4df7c1f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:02.055514 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:05:02.055514 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: warnings.warn(msg) Jun 23 17:05:02.089713 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-2b444ba3-a017-49f9-bcb8-c02e4df7c1f4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039344 Jun 23 17:05:02.090335 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 5/9] 10.222.0.18 () {64 vars in 1335 bytes} [Thu Jun 23 17:05:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:05:04.136210 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-dd72a3dd-d209-4f1d-8ad5-a29626c8ccf9 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:04.137234 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-dd72a3dd-d209-4f1d-8ad5-a29626c8ccf9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 23 17:05:04.137614 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 23 17:05:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:04.202161 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-a9846c7f-fbfb-4889-bdd3-3332290eeb2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:04.222634 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-a9846c7f-fbfb-4889-bdd3-3332290eeb2e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079007 Jun 23 17:05:04.223187 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 6/11] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 23 17:05:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:05:04.235060 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-5fb94556-ca11-4b19-9942-e53c9044d045 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:04.260934 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-5fb94556-ca11-4b19-9942-e53c9044d045 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029614 Jun 23 17:05:04.262271 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 6/12] 10.222.0.18 () {64 vars in 1335 bytes} [Thu Jun 23 17:05:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:05:06.344181 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-a9846c7f-fbfb-4889-bdd3-3332290eeb2e admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:06.345585 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-a9846c7f-fbfb-4889-bdd3-3332290eeb2e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Jun 23 17:05:06.357836 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 7/13] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 23 17:05:06 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:06.428951 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-7cd900aa-6d8a-4826-906f-bf92b45d9458 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "vcpus": 2, "disk": 10, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:06.449078 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-7cd900aa-6d8a-4826-906f-bf92b45d9458 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.097486 Jun 23 17:05:06.449626 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 7/14] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 23 17:05:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:05:06.461721 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-8ef097a6-eee4-41f6-bda3-f8e2d08543a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:06.485643 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-8ef097a6-eee4-41f6-bda3-f8e2d08543a8 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027757 Jun 23 17:05:06.486293 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 8/15] 10.222.0.18 () {64 vars in 1335 bytes} [Thu Jun 23 17:05:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:05:08.553736 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-7cd900aa-6d8a-4826-906f-bf92b45d9458 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:08.554781 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-7cd900aa-6d8a-4826-906f-bf92b45d9458 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 23 17:05:08.555144 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 8/16] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 23 17:05:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:08.629471 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-873eaf62-9e0b-434e-af32-58c239f9234e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:08.649215 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-873eaf62-9e0b-434e-af32-58c239f9234e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.088048 Jun 23 17:05:08.649780 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 9/17] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 23 17:05:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:05:08.663005 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-990ab8d0-77c4-4364-8735-fd2a779e5e9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:08.701889 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-990ab8d0-77c4-4364-8735-fd2a779e5e9a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027365 Jun 23 17:05:08.701889 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 9/18] 10.222.0.18 () {64 vars in 1335 bytes} [Thu Jun 23 17:05:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:05:10.777502 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-873eaf62-9e0b-434e-af32-58c239f9234e admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:10.778625 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-873eaf62-9e0b-434e-af32-58c239f9234e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jun 23 17:05:10.779041 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 10/19] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 23 17:05:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:10.842725 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-95d3d794-11cd-4a21-b81c-20c5a1ee8cd6 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:10.869373 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-95d3d794-11cd-4a21-b81c-20c5a1ee8cd6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083890 Jun 23 17:05:10.870279 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 10/20] 10.222.0.18 () {60 vars in 1291 bytes} [Thu Jun 23 17:05:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:05:12.999419 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-873eaf62-9e0b-434e-af32-58c239f9234e admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:13.000627 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-873eaf62-9e0b-434e-af32-58c239f9234e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 23 17:05:13.002909 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 11/21] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 23 17:05:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:13.063784 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-34f521c1-7e69-43e7-8802-93982f4b55e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "disk": 1, "ram": 512}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:13.084064 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-34f521c1-7e69-43e7-8802-93982f4b55e1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074950 Jun 23 17:05:13.084808 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 11/22] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 23 17:05:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:05:13.097211 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-7c5f0627-98b1-43fc-ace6-cd660b26a309 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:13.125765 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-7c5f0627-98b1-43fc-ace6-cd660b26a309 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031975 Jun 23 17:05:13.127341 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 12/23] 10.222.0.18 () {64 vars in 1332 bytes} [Thu Jun 23 17:05:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:05:15.763440 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-34f521c1-7e69-43e7-8802-93982f4b55e1 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:15.764752 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-34f521c1-7e69-43e7-8802-93982f4b55e1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001818 Jun 23 17:05:15.765321 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 23 17:05:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:15.828297 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-c42c4625-c1dc-4d81-b389-bf8ec4e918ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "vcpus": 1, "swap": 0, "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:15.847938 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-c42c4625-c1dc-4d81-b389-bf8ec4e918ce admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076428 Jun 23 17:05:15.848495 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 13/25] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 23 17:05:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:05:15.861639 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-fdf8cf96-0691-4c1a-a690-f337974df881 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:15.884949 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-fdf8cf96-0691-4c1a-a690-f337974df881 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027435 Jun 23 17:05:15.885537 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 13/26] 10.222.0.18 () {64 vars in 1332 bytes} [Thu Jun 23 17:05:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:05:17.990188 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-c42c4625-c1dc-4d81-b389-bf8ec4e918ce admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:17.991212 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-c42c4625-c1dc-4d81-b389-bf8ec4e918ce admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001645 Jun 23 17:05:17.991605 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 23 17:05:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:05:18.057444 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-b6586f0a-a5b8-41a5-9eb1-5d94d047b5ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:18.078032 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-b6586f0a-a5b8-41a5-9eb1-5d94d047b5ec admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.080276 Jun 23 17:05:18.078675 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 14/28] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 23 17:05:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 17:05:18.095759 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-754c84ef-2db5-41d0-80e1-1c9074861afc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:18.134277 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-754c84ef-2db5-41d0-80e1-1c9074861afc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045966 Jun 23 17:05:18.135583 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 15/29] 10.222.0.18 () {64 vars in 1332 bytes} [Thu Jun 23 17:05:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:05:20.187631 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-b6586f0a-a5b8-41a5-9eb1-5d94d047b5ec admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:20.188849 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-b6586f0a-a5b8-41a5-9eb1-5d94d047b5ec admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001653 Jun 23 17:05:20.189208 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 15/30] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 23 17:05:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:20.250017 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-0230dde2-627c-4ccd-8e5b-5ac24f71459c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:20.269447 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-0230dde2-627c-4ccd-8e5b-5ac24f71459c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074325 Jun 23 17:05:20.270022 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 16/31] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 23 17:05:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:05:20.281972 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-bef24590-5175-44fd-9bce-663a54619a19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:20.306500 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-bef24590-5175-44fd-9bce-663a54619a19 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028243 Jun 23 17:05:20.307270 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 16/32] 10.222.0.18 () {64 vars in 1332 bytes} [Thu Jun 23 17:05:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:05:22.387210 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-0230dde2-627c-4ccd-8e5b-5ac24f71459c admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:22.388279 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-0230dde2-627c-4ccd-8e5b-5ac24f71459c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001665 Jun 23 17:05:22.388707 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 17/33] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 23 17:05:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:22.451587 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-02e78fdf-caba-4209-8cb7-64e10a681585 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 160}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:22.473728 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-02e78fdf-caba-4209-8cb7-64e10a681585 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078403 Jun 23 17:05:22.474679 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 17/34] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 23 17:05:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 17:05:22.488281 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-1c83f6fa-4868-4daa-8b80-97b696e00849 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:22.513003 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-1c83f6fa-4868-4daa-8b80-97b696e00849 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029418 Jun 23 17:05:22.513581 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 18/35] 10.222.0.18 () {64 vars in 1332 bytes} [Thu Jun 23 17:05:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:05:46.826241 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-02e78fdf-caba-4209-8cb7-64e10a681585 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:46.827244 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-02e78fdf-caba-4209-8cb7-64e10a681585 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 23 17:05:46.827638 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 18/36] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 23 17:05:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:46.838430 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:05:46.895624 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-a5b0a90d-344f-405a-b244-575912bed6b3 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:46.913942 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-a5b0a90d-344f-405a-b244-575912bed6b3 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.080236 Jun 23 17:05:46.914477 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1291 bytes} [Thu Jun 23 17:05:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:05:47.871258 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-02e78fdf-caba-4209-8cb7-64e10a681585 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:47.872256 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-02e78fdf-caba-4209-8cb7-64e10a681585 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 23 17:05:47.872656 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 23 17:05:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:48.066883 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-0b6beaf4-9431-412c-bfd7-e9f8b75a9748 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:48.073218 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.wsgi [None req-0b6beaf4-9431-412c-bfd7-e9f8b75a9748 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-0b6beaf4-9431-412c-bfd7-e9f8b75a9748 admin admin] Request method failure captured: Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Accept: application/json Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Accept-Encoding: gzip, deflate Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Connection: keep-alive Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Content-Length: 0 Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Host: 10.222.0.18 Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Openstack-Api-Version: compute 2.90 Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Openstack-System-Scope: None Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: User-Agent: python-novaclient Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Auth-Token: gAAAAABitJ1r-pUMSxb3-_engbr-imRSBV9z5d4fAbZ7000YqgfvF9fbF8B5aIsEOPig2jCj6aztmt_W1ZDbxqpvwoUFoA1o8h72b3AKJsq-fzdMsytTeWgJKDZOvXHjXsXKkv5haDIUiBr2u_G5W69ah1juSgoStG3UpZAO9DapTioSU5Ej81k Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Domain-Id: None Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Domain-Name: None Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Identity-Status: Confirmed Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Is-Admin-Project: True Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Project-Domain-Id: default Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Project-Domain-Name: Default Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Project-Id: 817b32abe9534b1196adc7d371e17f3c Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Project-Name: admin Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Role: reader,member,admin Jun 23 17:05:48.076540 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Roles: reader,member,admin Jun 23 17:05:48.077985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/817b32abe9534b1196adc7d371e17f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/817b32abe9534b1196adc7d371e17f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_817b32abe9534b1196adc7d371e17f3c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/817b32abe9534b1196adc7d371e17f3c"}]}] Jun 23 17:05:48.077985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Tenant: admin Jun 23 17:05:48.077985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Tenant-Id: 817b32abe9534b1196adc7d371e17f3c Jun 23 17:05:48.077985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Tenant-Name: admin Jun 23 17:05:48.077985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User: admin Jun 23 17:05:48.077985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User-Domain-Id: default Jun 23 17:05:48.077985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User-Domain-Name: Default Jun 23 17:05:48.077985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User-Id: 6aa38b5acec04d4fa14aadd10b58f34f Jun 23 17:05:48.077985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User-Name: admin Jun 23 17:05:48.077985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: method: > Jun 23 17:05:48.077985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: exception: Flavor 42 could not be found. Jun 23 17:05:48.077985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: action_args: {'id': '42'} Jun 23 17:05:48.077985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:05:48.077985 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:05:48.079055 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:48.080597 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-0b6beaf4-9431-412c-bfd7-e9f8b75a9748 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103377) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:05:48.082062 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-0b6beaf4-9431-412c-bfd7-e9f8b75a9748 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069875 Jun 23 17:05:48.082062 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Jun 23 17:05:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:48.088000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-1ff02cbb-05cd-402d-8745-fbc11cd2ac6c admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:48.090990 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:05:48.110601 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-1ff02cbb-05cd-402d-8745-fbc11cd2ac6c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026153 Jun 23 17:05:48.111227 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Jun 23 17:05:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 17:05:48.123472 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-a5343c1f-b7f2-4b54-9830-eb95bda79f38 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:48.152997 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-a5343c1f-b7f2-4b54-9830-eb95bda79f38 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035334 Jun 23 17:05:48.153533 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Jun 23 17:05:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:05:48.165720 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-8e002e56-43d0-4e31-b0e3-530660825dae admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:48.174822 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.wsgi [None req-8e002e56-43d0-4e31-b0e3-530660825dae admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-8e002e56-43d0-4e31-b0e3-530660825dae admin admin] Request method failure captured: Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Accept: application/json Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Accept-Encoding: gzip, deflate Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Connection: keep-alive Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Content-Length: 0 Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Host: 10.222.0.18 Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Openstack-Api-Version: compute 2.90 Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Openstack-System-Scope: None Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: User-Agent: python-novaclient Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Auth-Token: gAAAAABitJ1r-pUMSxb3-_engbr-imRSBV9z5d4fAbZ7000YqgfvF9fbF8B5aIsEOPig2jCj6aztmt_W1ZDbxqpvwoUFoA1o8h72b3AKJsq-fzdMsytTeWgJKDZOvXHjXsXKkv5haDIUiBr2u_G5W69ah1juSgoStG3UpZAO9DapTioSU5Ej81k Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Domain-Id: None Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Domain-Name: None Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Identity-Status: Confirmed Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Is-Admin-Project: True Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Project-Domain-Id: default Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Project-Domain-Name: Default Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Project-Id: 817b32abe9534b1196adc7d371e17f3c Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Project-Name: admin Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Role: reader,member,admin Jun 23 17:05:48.179896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Roles: reader,member,admin Jun 23 17:05:48.181426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/817b32abe9534b1196adc7d371e17f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/817b32abe9534b1196adc7d371e17f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_817b32abe9534b1196adc7d371e17f3c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/817b32abe9534b1196adc7d371e17f3c"}]}] Jun 23 17:05:48.181426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Tenant: admin Jun 23 17:05:48.181426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Tenant-Id: 817b32abe9534b1196adc7d371e17f3c Jun 23 17:05:48.181426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Tenant-Name: admin Jun 23 17:05:48.181426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User: admin Jun 23 17:05:48.181426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User-Domain-Id: default Jun 23 17:05:48.181426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User-Domain-Name: Default Jun 23 17:05:48.181426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User-Id: 6aa38b5acec04d4fa14aadd10b58f34f Jun 23 17:05:48.181426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User-Name: admin Jun 23 17:05:48.181426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: method: > Jun 23 17:05:48.181426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: exception: Flavor 42 could not be found. Jun 23 17:05:48.181426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: action_args: {'id': '42'} Jun 23 17:05:48.181426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:05:48.181426 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:05:48.182396 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:48.183525 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-8e002e56-43d0-4e31-b0e3-530660825dae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:05:48.184597 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-8e002e56-43d0-4e31-b0e3-530660825dae admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.021357 Jun 23 17:05:48.184597 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Jun 23 17:05:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:49.034232 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-a5343c1f-b7f2-4b54-9830-eb95bda79f38 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:49.035249 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-a5343c1f-b7f2-4b54-9830-eb95bda79f38 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 23 17:05:49.035644 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 22/43] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 23 17:05:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:49.238937 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-6e8695a7-8912-4f44-bcb2-639543fd0692 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:49.247134 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.wsgi [None req-6e8695a7-8912-4f44-bcb2-639543fd0692 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-6e8695a7-8912-4f44-bcb2-639543fd0692 admin admin] Request method failure captured: Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Accept: application/json Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Accept-Encoding: gzip, deflate Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Connection: keep-alive Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Content-Length: 0 Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Host: 10.222.0.18 Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Openstack-Api-Version: compute 2.90 Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Openstack-System-Scope: None Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: User-Agent: python-novaclient Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Auth-Token: gAAAAABitJ1t2AM9BDo9cyOiOChFlwvqExvYRcFfaDlmQW7yO2-KwtNy76Ih3ovE8ftmzHiOmA6Aq37Jcz4OwIeHelAjrBhndCegD6YuWRppKOfyKzKJXgiug_BERoGyFKTmLF9Jhge_C7V_yFKNfp3hqHUDaEPChSkInQrmIVImBDwv9iG-znQ Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Domain-Id: None Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Domain-Name: None Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Identity-Status: Confirmed Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Is-Admin-Project: True Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Project-Domain-Id: default Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Project-Domain-Name: Default Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Project-Id: 817b32abe9534b1196adc7d371e17f3c Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Project-Name: admin Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Role: reader,member,admin Jun 23 17:05:49.249470 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Roles: reader,member,admin Jun 23 17:05:49.251113 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/817b32abe9534b1196adc7d371e17f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/817b32abe9534b1196adc7d371e17f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_817b32abe9534b1196adc7d371e17f3c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/817b32abe9534b1196adc7d371e17f3c"}]}] Jun 23 17:05:49.251113 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Tenant: admin Jun 23 17:05:49.251113 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Tenant-Id: 817b32abe9534b1196adc7d371e17f3c Jun 23 17:05:49.251113 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Tenant-Name: admin Jun 23 17:05:49.251113 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User: admin Jun 23 17:05:49.251113 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User-Domain-Id: default Jun 23 17:05:49.251113 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User-Domain-Name: Default Jun 23 17:05:49.251113 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User-Id: 6aa38b5acec04d4fa14aadd10b58f34f Jun 23 17:05:49.251113 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User-Name: admin Jun 23 17:05:49.251113 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: method: > Jun 23 17:05:49.251113 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: exception: Flavor 84 could not be found. Jun 23 17:05:49.251113 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: action_args: {'id': '84'} Jun 23 17:05:49.251113 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:05:49.251113 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:05:49.252000 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:49.253968 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-6e8695a7-8912-4f44-bcb2-639543fd0692 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:05:49.255088 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-6e8695a7-8912-4f44-bcb2-639543fd0692 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.075271 Jun 23 17:05:49.255088 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Jun 23 17:05:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:49.261238 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-b3917f20-5043-458e-8a63-581664738f98 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:49.275272 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-b3917f20-5043-458e-8a63-581664738f98 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017740 Jun 23 17:05:49.275834 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Jun 23 17:05:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:05:49.285522 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-4412f69b-47d2-4368-a217-382c838889bc admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:49.301451 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-4412f69b-47d2-4368-a217-382c838889bc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019561 Jun 23 17:05:49.301979 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Jun 23 17:05:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:05:49.311565 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-01c02fb7-252d-41a4-89d0-5e54ec954801 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:49.317500 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.wsgi [None req-01c02fb7-252d-41a4-89d0-5e54ec954801 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-01c02fb7-252d-41a4-89d0-5e54ec954801 admin admin] Request method failure captured: Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Accept: application/json Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Accept-Encoding: gzip, deflate Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Connection: keep-alive Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Content-Length: 0 Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Host: 10.222.0.18 Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Openstack-Api-Version: compute 2.90 Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Openstack-System-Scope: None Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: User-Agent: python-novaclient Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Auth-Token: gAAAAABitJ1t2AM9BDo9cyOiOChFlwvqExvYRcFfaDlmQW7yO2-KwtNy76Ih3ovE8ftmzHiOmA6Aq37Jcz4OwIeHelAjrBhndCegD6YuWRppKOfyKzKJXgiug_BERoGyFKTmLF9Jhge_C7V_yFKNfp3hqHUDaEPChSkInQrmIVImBDwv9iG-znQ Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Domain-Id: None Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Domain-Name: None Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Identity-Status: Confirmed Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Is-Admin-Project: True Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Project-Domain-Id: default Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Project-Domain-Name: Default Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Project-Id: 817b32abe9534b1196adc7d371e17f3c Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Project-Name: admin Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Role: reader,member,admin Jun 23 17:05:49.319042 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Roles: reader,member,admin Jun 23 17:05:49.320770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/817b32abe9534b1196adc7d371e17f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/817b32abe9534b1196adc7d371e17f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_817b32abe9534b1196adc7d371e17f3c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/817b32abe9534b1196adc7d371e17f3c"}]}] Jun 23 17:05:49.320770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Tenant: admin Jun 23 17:05:49.320770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Tenant-Id: 817b32abe9534b1196adc7d371e17f3c Jun 23 17:05:49.320770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Tenant-Name: admin Jun 23 17:05:49.320770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User: admin Jun 23 17:05:49.320770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User-Domain-Id: default Jun 23 17:05:49.320770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User-Domain-Name: Default Jun 23 17:05:49.320770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User-Id: 6aa38b5acec04d4fa14aadd10b58f34f Jun 23 17:05:49.320770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User-Name: admin Jun 23 17:05:49.320770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: method: > Jun 23 17:05:49.320770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: exception: Flavor 84 could not be found. Jun 23 17:05:49.320770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: action_args: {'id': '84'} Jun 23 17:05:49.320770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:05:49.320770 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:05:49.321617 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:49.322882 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-01c02fb7-252d-41a4-89d0-5e54ec954801 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103377) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:05:49.323937 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-01c02fb7-252d-41a4-89d0-5e54ec954801 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012549 Jun 23 17:05:49.323937 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 24/47] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Jun 23 17:05:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:50.168523 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-4412f69b-47d2-4368-a217-382c838889bc admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:50.169527 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-4412f69b-47d2-4368-a217-382c838889bc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jun 23 17:05:50.169946 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 24/48] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 23 17:05:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:50.376655 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-96e67ba6-38dc-4823-be37-1fd1f52d3d1d admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:50.386188 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.wsgi [None req-96e67ba6-38dc-4823-be37-1fd1f52d3d1d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-96e67ba6-38dc-4823-be37-1fd1f52d3d1d admin admin] Request method failure captured: Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Accept: application/json Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Accept-Encoding: gzip, deflate Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Connection: keep-alive Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Content-Length: 0 Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Host: 10.222.0.18 Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Openstack-Api-Version: compute 2.90 Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Openstack-System-Scope: None Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: User-Agent: python-novaclient Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Auth-Token: gAAAAABitJ1ukWuZWKxVY3NeovtpWoW_N6trS8m9cs-Q3VW1iuYgcY6SspH7WyzvEg715jxyUSn1Ms8xKu-CK0CkAP02i9-9okYvuXrXx-QoTk1YPtNh3dBP9wpISwbkQ4qImUYDr5a2Tp0-m-QM0MotaUi__5rNOj1zWjbwhNGQUGj7NR4U7Ko Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Domain-Id: None Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Domain-Name: None Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Identity-Status: Confirmed Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Is-Admin-Project: True Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Project-Domain-Id: default Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Project-Domain-Name: Default Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Project-Id: 817b32abe9534b1196adc7d371e17f3c Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Project-Name: admin Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Role: reader,member,admin Jun 23 17:05:50.388491 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Roles: reader,member,admin Jun 23 17:05:50.390000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/817b32abe9534b1196adc7d371e17f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/817b32abe9534b1196adc7d371e17f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_817b32abe9534b1196adc7d371e17f3c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/817b32abe9534b1196adc7d371e17f3c"}]}] Jun 23 17:05:50.390000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Tenant: admin Jun 23 17:05:50.390000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Tenant-Id: 817b32abe9534b1196adc7d371e17f3c Jun 23 17:05:50.390000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-Tenant-Name: admin Jun 23 17:05:50.390000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User: admin Jun 23 17:05:50.390000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User-Domain-Id: default Jun 23 17:05:50.390000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User-Domain-Name: Default Jun 23 17:05:50.390000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User-Id: 6aa38b5acec04d4fa14aadd10b58f34f Jun 23 17:05:50.390000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: X-User-Name: admin Jun 23 17:05:50.390000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: method: > Jun 23 17:05:50.390000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: exception: Flavor 451 could not be found. Jun 23 17:05:50.390000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: action_args: {'id': '451'} Jun 23 17:05:50.390000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:05:50.390000 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:05:50.391024 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: ERROR nova.api.openstack.wsgi Jun 23 17:05:50.392408 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-96e67ba6-38dc-4823-be37-1fd1f52d3d1d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103377) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:05:50.393845 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-96e67ba6-38dc-4823-be37-1fd1f52d3d1d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.083256 Jun 23 17:05:50.393845 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 25/49] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Jun 23 17:05:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:50.399916 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-b58ccd80-0cf9-4cfc-b7f1-0a2b0e0f4680 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:50.414173 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-b58ccd80-0cf9-4cfc-b7f1-0a2b0e0f4680 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017828 Jun 23 17:05:50.414690 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 25/50] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Jun 23 17:05:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:05:50.424250 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-451740e0-52e1-48c7-b07d-f0f78f0a61e9 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:50.437819 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-451740e0-52e1-48c7-b07d-f0f78f0a61e9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017200 Jun 23 17:05:50.438333 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 26/51] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Jun 23 17:05:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 17:05:50.448389 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-0913e303-1a4e-4bee-b6c0-f8ad12507bf8 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:50.454045 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.wsgi [None req-0913e303-1a4e-4bee-b6c0-f8ad12507bf8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-0913e303-1a4e-4bee-b6c0-f8ad12507bf8 admin admin] Request method failure captured: Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Accept: application/json Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Accept-Encoding: gzip, deflate Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Connection: keep-alive Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Content-Length: 0 Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Host: 10.222.0.18 Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Openstack-Api-Version: compute 2.90 Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Openstack-System-Scope: None Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: User-Agent: python-novaclient Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Auth-Token: gAAAAABitJ1ukWuZWKxVY3NeovtpWoW_N6trS8m9cs-Q3VW1iuYgcY6SspH7WyzvEg715jxyUSn1Ms8xKu-CK0CkAP02i9-9okYvuXrXx-QoTk1YPtNh3dBP9wpISwbkQ4qImUYDr5a2Tp0-m-QM0MotaUi__5rNOj1zWjbwhNGQUGj7NR4U7Ko Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Domain-Id: None Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Domain-Name: None Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Identity-Status: Confirmed Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Is-Admin-Project: True Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Project-Domain-Id: default Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Project-Domain-Name: Default Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Project-Id: 817b32abe9534b1196adc7d371e17f3c Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Project-Name: admin Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Role: reader,member,admin Jun 23 17:05:50.455647 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Roles: reader,member,admin Jun 23 17:05:50.457166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/817b32abe9534b1196adc7d371e17f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/817b32abe9534b1196adc7d371e17f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_817b32abe9534b1196adc7d371e17f3c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/817b32abe9534b1196adc7d371e17f3c"}]}] Jun 23 17:05:50.457166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Tenant: admin Jun 23 17:05:50.457166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Tenant-Id: 817b32abe9534b1196adc7d371e17f3c Jun 23 17:05:50.457166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-Tenant-Name: admin Jun 23 17:05:50.457166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User: admin Jun 23 17:05:50.457166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User-Domain-Id: default Jun 23 17:05:50.457166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User-Domain-Name: Default Jun 23 17:05:50.457166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User-Id: 6aa38b5acec04d4fa14aadd10b58f34f Jun 23 17:05:50.457166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: X-User-Name: admin Jun 23 17:05:50.457166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: method: > Jun 23 17:05:50.457166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: exception: Flavor 451 could not be found. Jun 23 17:05:50.457166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: action_args: {'id': '451'} Jun 23 17:05:50.457166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:05:50.457166 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:05:50.458101 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: ERROR nova.api.openstack.wsgi Jun 23 17:05:50.459169 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-0913e303-1a4e-4bee-b6c0-f8ad12507bf8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:05:50.460195 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-0913e303-1a4e-4bee-b6c0-f8ad12507bf8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012927 Jun 23 17:05:50.460195 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 26/52] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Jun 23 17:05:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:51.276881 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-451740e0-52e1-48c7-b07d-f0f78f0a61e9 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:51.277928 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-451740e0-52e1-48c7-b07d-f0f78f0a61e9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 23 17:05:51.278315 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 23 17:05:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:51.479607 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-1b652005-278f-4439-8a85-c246afa5a622 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:51.499624 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-1b652005-278f-4439-8a85-c246afa5a622 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.084061 Jun 23 17:05:51.500167 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 27/54] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Jun 23 17:05:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:05:52.324025 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-451740e0-52e1-48c7-b07d-f0f78f0a61e9 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:52.325036 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-451740e0-52e1-48c7-b07d-f0f78f0a61e9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 23 17:05:52.325423 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 23 17:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:52.527909 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-dcf3c552-e669-4c97-848d-0aafb663ece4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:52.549730 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-dcf3c552-e669-4c97-848d-0aafb663ece4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.088336 Jun 23 17:05:52.550310 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 28/56] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Jun 23 17:05:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:05:53.385370 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-451740e0-52e1-48c7-b07d-f0f78f0a61e9 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:53.386731 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-451740e0-52e1-48c7-b07d-f0f78f0a61e9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Jun 23 17:05:53.387248 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 29/57] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 23 17:05:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:53.585604 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-546893d8-628f-43c5-a12f-1713b7476855 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:53.605306 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-546893d8-628f-43c5-a12f-1713b7476855 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.080138 Jun 23 17:05:53.606924 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 29/58] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Jun 23 17:05:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:05:54.441579 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-451740e0-52e1-48c7-b07d-f0f78f0a61e9 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:54.442622 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-451740e0-52e1-48c7-b07d-f0f78f0a61e9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 23 17:05:54.443008 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 30/59] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 23 17:05:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:54.652995 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-f5aa6b75-8a2c-41f2-9717-69923c9897bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:05:54.677004 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-f5aa6b75-8a2c-41f2-9717-69923c9897bd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.095329 Jun 23 17:05:54.677543 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 30/60] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Jun 23 17:05:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:05:55.510832 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-451740e0-52e1-48c7-b07d-f0f78f0a61e9 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:55.512154 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-451740e0-52e1-48c7-b07d-f0f78f0a61e9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Jun 23 17:05:55.512615 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 31/61] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 23 17:05:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:05:55.716352 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-b4d8433a-4834-469e-bcec-645d02811cf3 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:05:55.735828 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-b4d8433a-4834-469e-bcec-645d02811cf3 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.083054 Jun 23 17:05:55.736334 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 31/62] 10.222.0.18 () {60 vars in 1202 bytes} [Thu Jun 23 17:05:55 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:06:42.559536 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-451740e0-52e1-48c7-b07d-f0f78f0a61e9 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:06:42.560831 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-451740e0-52e1-48c7-b07d-f0f78f0a61e9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Jun 23 17:06:42.561353 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 32/63] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 23 17:06:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:06:42.572074 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:06:42.624366 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-d7329e91-58d2-4f1d-86fc-ab4370b1e58d admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:06:42.643726 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-d7329e91-58d2-4f1d-86fc-ab4370b1e58d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076432 Jun 23 17:06:42.644238 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 32/64] 10.222.0.18 () {60 vars in 1291 bytes} [Thu Jun 23 17:06:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:06:42.667133 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-b02955b8-f373-4528-b510-792d82e64409 admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:06:42.670624 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG dbcounter [-] [103377] Writing DB stats nova_api:SELECT=14 {{(pid=103377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:06:42.676307 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-b02955b8-f373-4528-b510-792d82e64409 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012809 Jun 23 17:06:42.676819 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 33/65] 10.222.0.18 () {60 vars in 1282 bytes} [Thu Jun 23 17:06:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:06:42.689904 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-17df265a-8182-4941-90f7-52b806bc4b70 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:06:42.698634 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-17df265a-8182-4941-90f7-52b806bc4b70 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013360 Jun 23 17:06:42.699159 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 33/66] 10.222.0.18 () {60 vars in 1285 bytes} [Thu Jun 23 17:06:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:06:42.711052 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-c74119bb-94ce-4f01-8b6c-6e26ec4b345b admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:06:42.719040 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-c74119bb-94ce-4f01-8b6c-6e26ec4b345b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011645 Jun 23 17:06:42.719547 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 34/67] 10.222.0.18 () {60 vars in 1285 bytes} [Thu Jun 23 17:06:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:06:42.730795 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-7469dca9-b3d2-47d4-92f9-d20e110dd840 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:06:42.738896 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-7469dca9-b3d2-47d4-92f9-d20e110dd840 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011584 Jun 23 17:06:42.739341 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1282 bytes} [Thu Jun 23 17:06:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:09:55.274820 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-c74119bb-94ce-4f01-8b6c-6e26ec4b345b admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:09:55.276557 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-c74119bb-94ce-4f01-8b6c-6e26ec4b345b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002173 Jun 23 17:09:55.276936 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 35/69] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 23 17:09:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:09:55.417167 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_api:SELECT=6 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:09:55.550213 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-742ecfb5-d895-4c75-b94c-1b18b0afc3c1 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:09:55.551388 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:09:55.551388 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: warnings.warn(msg) Jun 23 17:09:55.552612 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-742ecfb5-d895-4c75-b94c-1b18b0afc3c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:09:55.553050 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-742ecfb5-d895-4c75-b94c-1b18b0afc3c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:09:55.553822 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-742ecfb5-d895-4c75-b94c-1b18b0afc3c1 admin admin] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:09:55.554279 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-742ecfb5-d895-4c75-b94c-1b18b0afc3c1 admin admin] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:09:55.588524 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-742ecfb5-d895-4c75-b94c-1b18b0afc3c1 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.172741 Jun 23 17:09:55.589059 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 35/70] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Jun 23 17:09:55 2022] GET /compute/v2.1/os-services => generated 794 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 17:09:56.558545 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-c74119bb-94ce-4f01-8b6c-6e26ec4b345b admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:09:56.559564 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-c74119bb-94ce-4f01-8b6c-6e26ec4b345b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jun 23 17:09:56.559993 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 23 17:09:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:09:56.778452 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-61a44b07-0192-4eb2-b30c-a574cd2c047b admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:09:56.779615 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:09:56.779615 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: warnings.warn(msg) Jun 23 17:09:56.780794 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-61a44b07-0192-4eb2-b30c-a574cd2c047b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:09:56.781249 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-61a44b07-0192-4eb2-b30c-a574cd2c047b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:09:56.782110 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-61a44b07-0192-4eb2-b30c-a574cd2c047b admin admin] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:09:56.782531 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-61a44b07-0192-4eb2-b30c-a574cd2c047b admin admin] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:09:56.801672 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-61a44b07-0192-4eb2-b30c-a574cd2c047b admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.091330 Jun 23 17:09:56.802262 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 36/72] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Jun 23 17:09:56 2022] GET /compute/v2.1/os-services => generated 794 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:10:08.070244 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-c74119bb-94ce-4f01-8b6c-6e26ec4b345b admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:10:08.071259 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-c74119bb-94ce-4f01-8b6c-6e26ec4b345b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 23 17:10:08.071654 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 23 17:10:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:10:08.212905 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_cell0:SELECT=4 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:10:08.213590 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_cell1:SELECT=4 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:10:08.214322 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG dbcounter [-] [103376] Writing DB stats nova_api:SELECT=8 {{(pid=103376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:10:08.267659 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-878c1fdb-6e67-4fc0-9680-874c3a8911a0 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:10:08.268873 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:10:08.268873 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: warnings.warn(msg) Jun 23 17:10:08.270104 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-878c1fdb-6e67-4fc0-9680-874c3a8911a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:10:08.270544 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-878c1fdb-6e67-4fc0-9680-874c3a8911a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:10:08.271313 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-878c1fdb-6e67-4fc0-9680-874c3a8911a0 admin admin] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:10:08.271731 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-878c1fdb-6e67-4fc0-9680-874c3a8911a0 admin admin] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:10:08.296557 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-878c1fdb-6e67-4fc0-9680-874c3a8911a0 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.088088 Jun 23 17:10:08.297312 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 37/74] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Jun 23 17:10:08 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:10:09.134921 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: DEBUG nova.api.openstack.wsgi [None req-c74119bb-94ce-4f01-8b6c-6e26ec4b345b admin admin] Calling method '>' {{(pid=103377) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:10:09.135936 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: INFO nova.api.openstack.requestlog [None req-c74119bb-94ce-4f01-8b6c-6e26ec4b345b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 23 17:10:09.136335 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: [pid: 103377|app: 0|req: 38/75] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 23 17:10:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:10:09.349866 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG nova.api.openstack.wsgi [None req-b841dc9c-0103-4fd9-a45f-23c568444c04 admin admin] Calling method '>' {{(pid=103376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:10:09.351112 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:10:09.351112 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: warnings.warn(msg) Jun 23 17:10:09.352342 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-b841dc9c-0103-4fd9-a45f-23c568444c04 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:10:09.352778 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-b841dc9c-0103-4fd9-a45f-23c568444c04 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:10:09.353570 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-b841dc9c-0103-4fd9-a45f-23c568444c04 admin admin] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:10:09.354125 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: DEBUG oslo_concurrency.lockutils [None req-b841dc9c-0103-4fd9-a45f-23c568444c04 admin admin] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:10:09.375421 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: INFO nova.api.openstack.requestlog [None req-b841dc9c-0103-4fd9-a45f-23c568444c04 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.087951 Jun 23 17:10:09.375964 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: [pid: 103376|app: 0|req: 38/76] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Jun 23 17:10:09 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:11:06.575784 dv-cinder-835384-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 23 17:11:06.576665 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: Thu Jun 23 17:11:06 2022 - graceful shutdown triggered... Jun 23 17:11:06.577180 dv-cinder-835384-10-iscsi devstack@n-api.service[103376]: Gracefully killing worker 1 (pid: 103376)... Jun 23 17:11:06.577545 dv-cinder-835384-10-iscsi devstack@n-api.service[103377]: Gracefully killing worker 2 (pid: 103377)... Jun 23 17:11:07.577995 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: worker 1 buried after 1 seconds Jun 23 17:11:07.577995 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: worker 2 buried after 1 seconds Jun 23 17:11:07.577995 dv-cinder-835384-10-iscsi devstack@n-api.service[103375]: goodbye to uWSGI. Jun 23 17:11:07.579941 dv-cinder-835384-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 23 17:11:07.580515 dv-cinder-835384-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 23 17:11:07.583401 dv-cinder-835384-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 17:11:07.594816 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 17:11:07.597496 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 17:11:07 2022] *** Jun 23 17:11:07.597496 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 17:11:07.597496 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 17:11:07.597496 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: nodename: dv-cinder-835384-10-iscsi Jun 23 17:11:07.597496 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: machine: x86_64 Jun 23 17:11:07.597496 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: clock source: unix Jun 23 17:11:07.597496 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: pcre jit disabled Jun 23 17:11:07.597496 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: detected number of CPU cores: 4 Jun 23 17:11:07.597496 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: current working directory: / Jun 23 17:11:07.597496 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: detected binary path: /usr/bin/uwsgi-core Jun 23 17:11:07.597496 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: your processes number limit is 47680 Jun 23 17:11:07.597496 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: your memory page size is 4096 bytes Jun 23 17:11:07.597496 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: detected max file descriptor number: 2048 Jun 23 17:11:07.597496 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: lock engine: pthread robust mutexes Jun 23 17:11:07.598780 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: thunder lock: enabled Jun 23 17:11:07.598780 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 17:11:07.598780 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 17:11:07.643646 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: Python main interpreter initialized at 0x5590a991f9c0 Jun 23 17:11:07.643646 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: python threads support enabled Jun 23 17:11:07.643646 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: your server socket listen backlog is limited to 100 connections Jun 23 17:11:07.643646 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: your mercy for graceful operations on workers is 90 seconds Jun 23 17:11:07.644135 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 17:11:07.644135 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: *** Operational MODE: preforking *** Jun 23 17:11:07.644388 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: *** uWSGI is running in multiple interpreter mode *** Jun 23 17:11:07.644388 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: spawned uWSGI master process (pid: 117879) Jun 23 17:11:07.644612 dv-cinder-835384-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 17:11:07.645358 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: spawned uWSGI worker 1 (pid: 117896, cores: 1) Jun 23 17:11:07.646095 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: spawned uWSGI worker 2 (pid: 117897, cores: 1) Jun 23 17:11:07.647455 dv-cinder-835384-10-iscsi devstack@n-api.service[117879]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 17:11:08.304012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 17:11:08.307593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 17:11:09.492755 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 17:11:09.492755 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: from cryptography.utils import int_from_bytes Jun 23 17:11:09.493494 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 17:11:09.493494 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: from cryptography.utils import int_from_bytes Jun 23 17:11:09.496531 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 17:11:09.496531 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: from cryptography.utils import int_from_bytes Jun 23 17:11:09.497015 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 17:11:09.497015 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: from cryptography.utils import int_from_bytes Jun 23 17:11:11.898794 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 17:11:11.899460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 17:11:11.899565 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 17:11:11.899895 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 17:11:11.900087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 17:11:11.900492 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.900813 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.901124 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.901445 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.901755 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.902102 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.902417 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.902730 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.903043 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.903311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.903617 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.903935 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-10-iscsi {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.904253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.904556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.904851 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.905162 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.905476 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.905813 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.906137 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.906607 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.912825 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.912825 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.912825 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.912825 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.912825 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.912825 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.912825 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.912825 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.913547 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.913547 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.913547 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-10-iscsi {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.913547 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.913547 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.913547 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.913547 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.913547 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.914534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.914534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.914534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.914534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.914534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.914534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.914534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.914534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.915680 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.915680 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.915680 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.915680 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.916236 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.916236 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.916542 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.917234 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.917234 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.917552 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.917850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.918097 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.918347 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.918665 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.918983 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.919287 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.919598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.919902 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.920206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.920512 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.920827 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.921126 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.921424 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.921738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.922079 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.922392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.922693 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.923009 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.923406 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.923654 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.923957 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.924295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.924605 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.924768 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 17:11:11.925250 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.925402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 17:11:11.925555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.925555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.925912 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 17:11:11.926117 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.926399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 17:11:11.926550 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.926798 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 17:11:11.926966 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.926966 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.927249 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.927402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.927545 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.927694 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.927929 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.928080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.928224 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.928388 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.928651 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.928801 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.929124 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.929310 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.929458 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.929626 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.930120 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.930306 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.930460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.930460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.930759 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.930759 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.931227 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.931227 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.931527 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.931678 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.931828 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-10-iscsi {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.931980 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.932140 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.932297 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.932441 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.932590 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.932734 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.932891 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.933040 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.933197 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.933349 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.933502 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.933654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.933870 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.934038 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.934203 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.934203 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.934533 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.934697 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.934848 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.935001 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.935154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.935305 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.935458 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.935458 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.935739 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.935893 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.936042 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.936191 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.936350 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.936495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.936646 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.936828 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.936982 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.937139 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.937289 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.937439 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.937589 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.937732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-10-iscsi {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.937929 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.938212 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.938372 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.938523 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.938758 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.938758 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.939068 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.939357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.939506 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.939663 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.939808 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.940253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.940413 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.940916 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.941071 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.941235 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.941548 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.941717 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.941906 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.942052 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.942251 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.942406 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.942586 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.942747 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.942900 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.943055 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.943198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.943348 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.943499 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.943651 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.943795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.943944 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.944087 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.944229 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.944229 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.944518 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.944669 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.944812 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.944812 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.945100 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.945302 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.945457 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.945610 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.945762 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.945983 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.946135 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.946292 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.946442 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.946585 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.946585 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.946885 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.947044 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.947196 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.947348 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.947491 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.947633 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.947784 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.947944 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.948097 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.948240 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.948388 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.948537 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.948689 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.948949 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.949105 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.949574 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.949725 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.949889 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.950064 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.950537 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.950722 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.950868 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.951018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.951169 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.951327 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.951501 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.951859 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.952003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.952145 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.952290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.952447 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.952597 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.952747 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.952891 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.953033 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.953175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.953328 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.953483 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.953636 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.953785 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.953972 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.954125 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.954319 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.954475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.954617 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.954760 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.954902 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.955059 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.955211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.955364 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.955526 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.955675 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.955824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.955976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.956119 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.956260 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.956404 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.956546 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.956697 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.956852 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.956995 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.957145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.957296 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.957523 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.957684 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.957869 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.958019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.958208 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.958370 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.958515 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.958780 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.958955 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.959188 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.959648 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.959808 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.959952 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.960116 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.960285 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.960780 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.960926 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.961071 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.961223 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.961381 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.961525 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.961525 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.962061 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.962214 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.962365 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.962519 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.962674 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.962827 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.962978 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.963122 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.963278 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.963430 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.963581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.963733 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.963733 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.963733 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.964147 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.964291 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.964449 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.964601 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.964752 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.964907 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.965052 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.965209 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.965366 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.965517 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.965661 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.965992 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.966159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.966315 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.966458 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.966620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.966620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.966620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.966620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.966620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.966620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.966620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.966620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.967713 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.967713 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.967713 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.968124 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.968268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.968433 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.968588 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.968588 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.968871 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.969015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.969176 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.969430 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.969585 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.969956 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.970109 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.970303 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.970479 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.971012 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.971178 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.971330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.971474 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.971616 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.971769 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.971921 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.972305 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.972457 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 17:11:11.972601 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.972743 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.972895 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.973078 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.973251 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.973397 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.973546 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.973696 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.973926 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.974077 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.974222 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.974420 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.974574 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.974767 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.974921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.975064 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.975206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.975361 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.975504 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.975504 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.975504 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.975934 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.976076 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.976226 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.976377 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.976529 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.976680 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.976824 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.976974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.976974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.977273 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.977425 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.977576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.977726 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.977890 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.978044 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.978198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.978348 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.978501 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.978644 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.978794 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.978938 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.979045 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.979133 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.979214 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.979308 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.979410 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.979504 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.979603 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.979696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.979696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.980101 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.980101 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.980101 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.980101 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.980101 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.980441 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.980515 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.980587 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.980694 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.981067 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.981151 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.981224 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.981304 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.981384 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.981511 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.981711 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.981873 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.982084 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.982202 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.982472 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.982579 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.982731 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.982822 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.983050 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.983140 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.983370 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.983468 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.983685 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.983774 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.983996 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.984084 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.984307 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.984388 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.984621 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.984704 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.984943 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.985031 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.985250 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.985334 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.985564 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.985645 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.985979 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.986143 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.986230 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.986303 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.986515 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.986599 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.986824 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.986913 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.987125 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.987206 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.987426 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.987506 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.987860 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.987974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.988049 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.988120 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.988357 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.988444 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.988738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.988842 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.989051 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.989363 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.989558 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.989667 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.990619 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.990845 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.991297 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.991462 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.991616 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.991902 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.992061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.992218 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.992371 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.992710 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.992868 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.993020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.993181 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.993333 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.993479 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.993622 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.993777 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.993960 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.994119 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.994272 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.994426 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.994570 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.994712 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.994855 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.995007 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.995151 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.995294 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.995444 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.995600 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.995762 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.995762 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.996063 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.996215 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.996359 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.996524 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.996677 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.996820 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.996963 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.997108 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.997251 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.997410 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.997574 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.997729 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.997944 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.998100 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.998252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.998404 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.998558 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.998709 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.998860 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.999011 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.999155 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.999298 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.999452 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.999613 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.999761 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:11.999904 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.000119 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.000288 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.000435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.000821 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.000990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.001431 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.001599 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.001767 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.002006 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.002155 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.002368 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.002526 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.002872 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.003033 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.003178 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.003329 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.003473 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.003617 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.003769 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.003933 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.004085 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.004259 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.004415 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.004578 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.004733 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.004892 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.005042 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.005185 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.005328 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.005328 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.005620 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.005767 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.005944 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.005944 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.006229 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.006429 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.006592 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.006746 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.006934 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.007084 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.007235 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.007379 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.007379 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.007669 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.007822 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.007974 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.008124 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.008277 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.008432 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.008583 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.008726 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.008877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.009020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.009171 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.009314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.009465 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.009465 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.009735 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.009913 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.010070 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.010221 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.010382 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.010382 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.010654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.011034 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.011201 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.011371 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.011752 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.011898 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.012126 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.012126 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.012423 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.012569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.012569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.012569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.013186 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.013350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.013350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.013350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.013350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.013350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.014082 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.014244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.014397 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.014542 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.014542 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.014542 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.014542 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.015111 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.015257 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.015399 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.015550 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.015550 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.015550 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.015958 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.016103 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.016103 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.016391 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.016543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.016783 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.016929 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.017071 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.017221 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.017366 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.017517 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.017670 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.017838 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.017998 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.018149 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.018313 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.018457 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.018608 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.018763 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.018906 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.019057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.019202 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.019345 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.019502 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.019653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.019797 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.020021 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.020187 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.020331 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.020475 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.020625 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.020799 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.020799 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.020799 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.021446 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.021827 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.021996 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.022158 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.022378 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.022527 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.022670 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.022821 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.023165 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.023333 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.023490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.023642 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.023785 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.023928 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.024094 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.024252 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.024403 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.024547 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.024691 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.024843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.024995 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.025153 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.025306 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.025460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.025612 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.025757 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.025974 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.026120 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.026272 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.026423 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.026567 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.026711 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.026863 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.027007 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.027158 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.027319 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.027463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.027613 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.027771 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.027923 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.028067 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.028210 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.028352 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.028495 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.028646 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.028798 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.028798 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.029080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.029242 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.029401 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.029401 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.029691 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.029863 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.030025 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.030803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.030964 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.030964 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.031476 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.031636 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.032016 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.032166 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.032328 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.032564 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.032730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.032883 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.033041 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.033460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.033619 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.033770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.033959 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.034120 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.034279 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.034484 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.034648 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.034648 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.034967 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.035130 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.035291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.035450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.035754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.035941 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.035941 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.036261 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.036261 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.036575 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.036728 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.036887 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.037039 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.037199 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.037357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.037507 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.037656 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.037840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.037999 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.038149 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.038331 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.038331 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.038331 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.038919 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.039173 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.039339 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.039498 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.039498 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.039795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.039955 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.040119 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.040277 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.040483 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.040636 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.040795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.040965 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.041124 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.041521 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.041690 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.041896 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.042311 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.042466 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.042721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.042885 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.043052 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.043212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.043370 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.043966 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.044151 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.044314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.044481 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.044641 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.044792 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.044922 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.045171 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.045272 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.045402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.045490 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.045566 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.045644 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.045725 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.045842 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.045922 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.046009 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.046082 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.046166 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.046249 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.046249 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.046417 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.046498 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.046591 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.046671 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.046745 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.046837 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.046930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.047014 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.047097 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.047189 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.047350 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.047350 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.047508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.047599 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.047693 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.047786 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.047885 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.047885 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.048058 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.048144 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.048236 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.048321 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.048414 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.048507 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.048602 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.048695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.048788 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.048875 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.048968 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.049061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.049154 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.049240 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.049325 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.049441 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.049529 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.049614 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.049697 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.049781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.050067 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.050171 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.050260 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.050352 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.050438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.050522 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.050614 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.050717 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.050805 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.050898 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.050993 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.051098 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.051195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.051296 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.051399 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.051717 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.051834 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.051989 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.052189 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.052435 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.052524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.052609 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.052780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.052923 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.053105 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.053212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.053418 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.053521 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.053744 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.053875 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.054088 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.054182 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.054399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.054493 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.054707 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.054800 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.055009 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.055102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.055320 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.055421 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.055622 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.055728 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.055933 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.056026 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.056235 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.056335 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.056541 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.056674 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.056848 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.056988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.057160 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.057299 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.057469 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.057603 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.057774 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.057942 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.058109 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.058252 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.058435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.058567 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.058761 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.058880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.059066 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.059167 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.059378 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.059589 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.059689 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.059903 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.059996 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.060212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.060316 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.060522 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.060615 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.060823 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.060925 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.061122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.061230 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.061431 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.061551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.061736 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.061877 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.062071 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.062182 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.062388 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.062548 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.062673 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.062776 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.062987 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.063091 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.063285 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.063378 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.063587 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.063684 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.063938 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.064043 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.064249 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.064354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.064596 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.064688 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.064910 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.065002 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.065230 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.065330 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.066003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.066122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.066245 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.066351 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.066561 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.066669 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.067006 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.067382 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.067485 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.067696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.067797 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.068006 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.068100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.068332 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.068425 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.068673 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.068765 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.069005 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.069112 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.069316 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.069461 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.069646 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.069769 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.070000 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.070150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.070330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.070484 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.070794 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.070957 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.071035 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.071118 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.071297 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.071544 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.071629 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.071904 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.072009 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.072174 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.072266 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.072498 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.072591 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.072810 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.072902 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.073113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.073215 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.073414 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.073505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.073764 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.073892 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.074092 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.074392 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.074683 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.074991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.075306 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.075426 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.075616 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.075718 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.075924 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.076025 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.076253 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.076373 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.076566 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.076660 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.076872 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.076964 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.077188 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.077295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.077497 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.077597 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.077843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.077948 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.078136 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.078227 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.078449 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.078579 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.078775 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.078899 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.079251 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.079358 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.079523 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.079664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.079837 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.080000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.080153 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.080314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.080491 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.080646 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.080778 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.080965 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.081087 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.081276 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.081512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.081613 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.081855 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.081979 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.082177 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.082294 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.082735 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.082980 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.083311 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.083624 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.083725 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.083944 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.084038 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.084281 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.084402 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.084597 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.084735 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.084909 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.085017 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.085219 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.085332 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.085548 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.085650 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.085884 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.085988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.086216 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.086324 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.086522 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.086645 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.086961 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.087050 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.087273 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.087369 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.087653 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.087766 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.087965 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.088065 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.088273 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.088367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.088580 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.088673 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.088880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.088987 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.089182 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.089283 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.089486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.089587 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.089843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.089956 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.090136 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.090229 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.090458 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.090560 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.090769 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.090871 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.091075 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.091176 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.091377 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.091483 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.091682 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.091785 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.092009 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.092097 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.092315 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.092418 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.092712 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.092817 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.092963 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.093062 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.093286 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.093409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.093619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.093734 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.093953 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.094057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.094277 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.094384 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.094596 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.094763 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.094916 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.095011 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.095230 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.095332 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.095541 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.095633 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.095851 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.095952 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.096159 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.096259 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.096472 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.096615 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.096777 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.096928 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.097084 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.097232 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.097378 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.097515 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.097686 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.097874 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.098092 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.098508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.098842 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.098983 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.099161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.099309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.099473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.099639 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.099779 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.099916 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.100086 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.100207 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.100399 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.100547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.100710 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.100860 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.101006 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.101172 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.101323 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.101480 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.101627 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.101766 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.101941 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.102045 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.102261 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.102377 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.102587 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.102700 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.102924 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.103053 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.103235 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.103346 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.103544 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.103645 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.103855 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.103967 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.104166 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.104267 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.104498 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.104605 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.104827 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.104937 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.105132 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.105234 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.105441 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.105544 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.105754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.105877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.106090 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.106196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.106401 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.106554 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.106706 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.106800 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.107016 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.107107 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.107323 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.107417 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.107628 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.107720 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.107939 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.108036 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.108237 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.108328 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.108547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.108694 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.108836 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.108982 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.109120 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.109281 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.109430 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.109569 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.109740 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.109899 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.110090 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.110250 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.110390 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.110528 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.110713 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.110900 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.111049 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.111206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.111345 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.111545 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.111639 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.111848 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.111945 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.112169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.112310 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.112483 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.112648 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.112793 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.112961 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.113092 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.113238 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.113397 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.113553 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.113715 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.114042 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.114373 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.114514 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.114711 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.114809 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.115029 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.115139 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.115355 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.115456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.115681 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.115783 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.116003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.116104 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.116303 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.116395 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.116633 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.116831 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.116937 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.117188 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.117289 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.117501 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.117601 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.117858 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.117974 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.118186 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.118455 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.118548 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.118787 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.118879 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.119106 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.119233 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.119406 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.119498 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.119704 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.119813 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.120018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.120112 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.120328 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.120421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.120627 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.120728 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.120928 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.121020 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.121235 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.121328 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.121538 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.121639 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.121858 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.121965 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.122222 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.122323 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.122526 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.122627 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.122850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.122951 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.123151 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.123251 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.123478 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.123575 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.123778 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.123868 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.124086 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.124196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.124393 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.124495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.124693 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.124786 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.124997 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.125106 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.125295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.125438 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.125604 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.125697 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.125927 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.126042 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.126234 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.126335 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.126536 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.126629 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.126842 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.126944 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.127141 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.127241 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.127448 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.127542 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.127772 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.127876 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.128090 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.128182 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.128391 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.128482 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.128693 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.128788 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.129006 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.129106 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.129397 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.129880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.129999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.130192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.130286 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.130501 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.130605 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.130843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.130945 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.131156 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.131367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.131685 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.131779 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.132018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.132112 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.132338 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.132431 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.132669 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.132769 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.132994 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.133087 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.133299 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.133391 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.133603 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.133704 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.133931 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.134027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.134253 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.134352 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.134559 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.134662 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.134864 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.134960 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.135170 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.135261 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.135474 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.135653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.135781 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.135871 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.136085 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.136177 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.136389 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.136496 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.136696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.136785 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.137003 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.137226 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.137319 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.137587 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.137680 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.137926 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.138035 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.138233 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.138337 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.138543 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.138644 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.138881 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.138976 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.139191 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.139298 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.139502 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.139600 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.139811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.139911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.140115 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.140214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.140419 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.140511 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.140722 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.140816 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.141026 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.141126 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.141329 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.141428 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.141639 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.141730 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.141979 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.142082 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.142288 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.142382 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.142590 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.142679 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.142893 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.143094 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.143224 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.143405 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.143535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.143721 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.143827 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.144133 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.144220 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.144448 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.144541 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.144755 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.144880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.145569 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.145681 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.145915 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.146025 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.146233 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.146340 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.146537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.146637 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.146862 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.146960 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.147183 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.147284 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.147496 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.147589 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.147815 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.147909 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.148118 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.148211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.148418 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.148511 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.148718 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.148865 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.149022 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.149123 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.149335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.149430 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.149640 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.149742 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.149964 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.150083 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.150266 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.150383 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.150571 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.150679 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.150869 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.150972 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.151170 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.151305 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.151471 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.151579 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.151770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.151863 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.152073 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.152370 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.152475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.152667 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.152764 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.152966 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.153059 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.153264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.153380 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.153567 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.153695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.153898 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.154037 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.154212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.154336 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.154514 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.154649 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.154812 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.154977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.155129 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.155300 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.155464 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.155620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.155758 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.156036 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.156230 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.156448 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.156592 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.156696 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.156881 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.157178 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.157422 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.157739 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.158080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.158395 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.158715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.159030 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.159349 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.159701 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.159871 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.160020 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.160324 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.160580 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.160946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.161193 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.161289 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.161540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.161650 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.161890 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.161999 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.162267 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.162369 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.162536 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.162638 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.162857 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.162950 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.163181 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.163269 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.163519 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.163622 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.163842 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.163934 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.164153 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.164253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.164472 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.164674 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.164770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.164997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.165099 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.165324 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.165418 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.165653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.165754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.165997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.166099 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.166327 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.166459 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.166656 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.166760 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.166985 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.167086 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.167297 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.167483 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.167608 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.167710 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.167941 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.168034 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.168253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.168359 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.168564 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.168665 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.168883 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.168984 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.169193 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.169301 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.169505 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.169605 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.169830 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.169954 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.170149 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.170264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.170471 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.170584 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.170783 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.170884 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.171090 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.171201 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.171398 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.171500 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.171712 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.171821 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.172020 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.172121 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.172327 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.172429 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.172637 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.172737 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.172943 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.173065 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.173260 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.173361 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.173562 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.173664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.173889 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.173996 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.174134 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 17:11:12.174235 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.174492 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.174798 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.175104 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.175417 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.175727 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.176034 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.176600 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.176914 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.177222 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.177556 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.177918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.178240 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.178573 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.178888 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.179213 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.179528 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.179855 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.180181 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.180501 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.180814 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.181150 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.181465 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.181782 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.182120 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.182434 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.182745 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.183058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.183388 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.183717 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.184024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.184351 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.184673 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.184994 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.185312 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.185625 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.185979 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.186298 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.186610 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.186932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.187249 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.187563 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.187881 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.188200 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.188534 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.188862 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.189175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.189503 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.189852 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.190205 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.190859 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.191213 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.191547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.192409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.192742 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.193053 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 17:11:12.193301 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 17:11:12.236440 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO dbcounter [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] Registered counter for database nova_api Jun 23 17:11:12.257517 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO dbcounter [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] Registered counter for database nova_api Jun 23 17:11:12.257775 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_db.sqlalchemy.engines [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:11:12.264142 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writer thread running {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:11:12.278714 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:11:12.286945 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writer thread running {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:11:12.324646 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.context [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d03b830d-8c4e-49e2-9a0f-91b2a277455e(cell1) {{(pid=117896) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 17:11:12.328787 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:11:12.330408 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:11:12.331203 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:11:12.333581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:11:12.335607 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO dbcounter [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] Registered counter for database nova_cell0 Jun 23 17:11:12.339677 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO dbcounter [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] Registered counter for database nova_cell1 Jun 23 17:11:12.346705 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.context [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d03b830d-8c4e-49e2-9a0f-91b2a277455e(cell1) {{(pid=117897) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 17:11:12.346988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_db.sqlalchemy.engines [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:11:12.349608 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_db.sqlalchemy.engines [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:11:12.351705 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:11:12.353315 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:11:12.354037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writer thread running {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:11:12.354148 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:11:12.356135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:11:12.358202 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO dbcounter [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] Registered counter for database nova_cell0 Jun 23 17:11:12.362282 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO dbcounter [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] Registered counter for database nova_cell1 Jun 23 17:11:12.370567 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:11:12.371966 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:11:12.378771 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writer thread running {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:11:12.380237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writer thread running {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:11:12.495610 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writer thread running {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:11:12.506270 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO dbcounter [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] Registered counter for database nova_cell0 Jun 23 17:11:12.513461 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_db.sqlalchemy.engines [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:11:12.518903 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writer thread running {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:11:12.529649 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO dbcounter [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] Registered counter for database nova_cell0 Jun 23 17:11:12.536941 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 17:11:12.541432 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writer thread running {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 17:11:12.859240 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: WARNING keystonemiddleware.auth_token [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 17:11:12.861770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: WARNING keystonemiddleware.auth_token [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 17:11:12.866889 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: WARNING keystonemiddleware.auth_token [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 17:11:12.869881 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: WARNING keystonemiddleware.auth_token [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 17:11:13.213718 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: WARNING keystonemiddleware.auth_token [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 17:11:13.219818 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: WARNING keystonemiddleware.auth_token [None req-d1e63a39-dcf5-40ed-80bf-195c73803a89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 17:11:13.225647 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5590a991f9c0 pid: 117897 (default app) Jun 23 17:11:13.227448 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: WARNING keystonemiddleware.auth_token [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 17:11:13.233483 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: WARNING keystonemiddleware.auth_token [None req-885f9465-5f14-4e96-b482-c44c3f2cb826 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 17:11:13.239005 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5590a991f9c0 pid: 117896 (default app) Jun 23 17:11:52.807183 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=3 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:52.808635 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=3 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:52.809634 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=3 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:52.810416 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=3 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:53.221760 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:53.222736 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:53.223480 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:53.224234 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:54.030898 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a03f7279-e67d-4b8d-b272-d792f71ed5dc tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] Action: 'create', calling method: .version_select at 0x7f342fb7d790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1289132266", "metadata": {"Type": "work"}}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:11:54.615471 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-aad4683c-e58e-4715-8e19-36b5235b8137 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Action: 'create', calling method: .version_select at 0x7f342fb82700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1407387777"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:11:56.282610 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a03f7279-e67d-4b8d-b272-d792f71ed5dc tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.486714 Jun 23 17:11:56.291205 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1155 bytes} [Thu Jun 23 17:11:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3497 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 17:11:56.297532 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-88492706-255b-4014-95f7-c4fee2252a16 tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] Calling method '.version_select at 0x7f342fa495e0>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:11:57.023672 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-aad4683c-e58e-4715-8e19-36b5235b8137 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.807360 Jun 23 17:11:57.031455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 1/2] 10.222.0.18 () {60 vars in 1154 bytes} [Thu Jun 23 17:11:53 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3817 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 17:11:57.042897 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-984f0fcb-c5f5-467a-83e9-dbfaa5ca976e tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] Calling method '.version_select at 0x7f342fa4a550>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:11:57.298609 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-88492706-255b-4014-95f7-c4fee2252a16 tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/691e06eb-9646-4fe0-b221-e4c3f55e7166" status: 200 len: 351 microversion: 2.1 time: 1.005367 Jun 23 17:11:57.299602 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 23 17:11:56 2022] GET /compute/v2.1/os-volumes/691e06eb-9646-4fe0-b221-e4c3f55e7166 => generated 351 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:11:57.305474 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9e42c23d-5f7c-40c8-81a3-893a1bb1e5b0 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342fa49820>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:11:57.405122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-984f0fcb-c5f5-467a-83e9-dbfaa5ca976e tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/07dd8617-e35a-46c9-b75d-fbbb20f4cc19" status: 200 len: 354 microversion: 2.1 time: 0.372042 Jun 23 17:11:57.406601 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 23 17:11:57 2022] GET /compute/v2.1/os-volumes/07dd8617-e35a-46c9-b75d-fbbb20f4cc19 => generated 354 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:11:57.429207 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7d6b59fd-dfce-482d-966e-2e72a8bbe4d9 tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] Calling method '.version_select at 0x7f342fa4a8b0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:11:57.584968 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9e42c23d-5f7c-40c8-81a3-893a1bb1e5b0 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8" status: 200 len: 346 microversion: 2.1 time: 0.284192 Jun 23 17:11:57.585615 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 3/5] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 23 17:11:57 2022] GET /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8 => generated 346 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:11:57.597475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-79747c8c-61d3-4632-bb6c-a3553ae3daba tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Action: 'create', calling method: .version_select at 0x7f342fa49dc0>, body: {"snapshot": {"volume_id": "1efb4909-daa6-4c2b-81d4-b358ae6607c8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1411394493"}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:11:57.782815 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7d6b59fd-dfce-482d-966e-2e72a8bbe4d9 tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/07dd8617-e35a-46c9-b75d-fbbb20f4cc19" status: 200 len: 354 microversion: 2.1 time: 0.302547 Jun 23 17:11:57.782815 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 3/6] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 23 17:11:57 2022] GET /compute/v2.1/os-volumes/07dd8617-e35a-46c9-b75d-fbbb20f4cc19 => generated 354 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:11:57.782815 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f39b00d1-1cc7-46b4-aa8d-05010ae83ac2 tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] Calling method '.version_select at 0x7f342fa4ad30>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:11:57.995685 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f39b00d1-1cc7-46b4-aa8d-05010ae83ac2 tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/07dd8617-e35a-46c9-b75d-fbbb20f4cc19" status: 202 len: 0 microversion: 2.1 time: 0.265093 Jun 23 17:11:57.999862 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 23 17:11:57 2022] DELETE /compute/v2.1/os-volumes/07dd8617-e35a-46c9-b75d-fbbb20f4cc19 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 17:11:58.009488 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-dcecd202-1572-4767-b56f-1f146ee88361 tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] Calling method '.version_select at 0x7f342fa5f430>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:11:58.125948 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-79747c8c-61d3-4632-bb6c-a3553ae3daba tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.532360 Jun 23 17:11:58.127473 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 4/8] 10.222.0.18 () {60 vars in 1161 bytes} [Thu Jun 23 17:11:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:11:58.139633 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-62d162f5-6549-4ee0-86ac-6e5042d30783 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342fa60a60>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:11:58.199983 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-62d162f5-6549-4ee0-86ac-6e5042d30783 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc" status: 200 len: 287 microversion: 2.1 time: 0.065825 Jun 23 17:11:58.200953 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 5/9] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 23 17:11:58 2022] GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:11:58.213709 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-616020fd-ad88-4ba9-b9fc-5efe13d55850 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342fa49d30>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:11:58.256373 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-dcecd202-1572-4767-b56f-1f146ee88361 tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/07dd8617-e35a-46c9-b75d-fbbb20f4cc19" status: 200 len: 353 microversion: 2.1 time: 0.251917 Jun 23 17:11:58.258240 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 5/10] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 23 17:11:58 2022] GET /compute/v2.1/os-volumes/07dd8617-e35a-46c9-b75d-fbbb20f4cc19 => generated 353 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:11:58.388935 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-616020fd-ad88-4ba9-b9fc-5efe13d55850 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.181044 Jun 23 17:11:58.389968 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 6/11] 10.222.0.18 () {58 vars in 1139 bytes} [Thu Jun 23 17:11:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:11:58.401191 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-10241a51-718a-48fb-86e3-c753f96c997f tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342fa4ad30>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:11:58.532170 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-10241a51-718a-48fb-86e3-c753f96c997f tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc" status: 200 len: 287 microversion: 2.1 time: 0.135157 Jun 23 17:11:58.534226 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 23 17:11:58 2022] GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc => generated 287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:11:59.273465 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-dca30bf0-ff44-4558-a242-1e77327a7219 tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] Calling method '.version_select at 0x7f342fa60b80>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:11:59.278810 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e8a7238a-cc9c-4f01-927c-e99b529e677f tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] Calling method '.version_select at 0x7f342fa4ab80>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:11:59.353615 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-dca30bf0-ff44-4558-a242-1e77327a7219 tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] HTTP exception thrown: Volume 07dd8617-e35a-46c9-b75d-fbbb20f4cc19 could not be found. Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-dca30bf0-ff44-4558-a242-1e77327a7219 tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] Request method failure captured: Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/os-volumes/07dd8617-e35a-46c9-b75d-fbbb20f4cc19 HTTP/1.1 Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7YzD_8nY1tww0TkSwGLRAutAVvSGXt0NCsXyKDyUM2Dsh0ZWmuBIvtxZflNJZi0kRLpParjByJv5UbjqQHjQ373UFpnckwiNEFgc08ox4rJsfM0jJCV_-VIxU_2vwslq5Wfbnt0ut2GpIj7Zkqb3_X1vYpprFb8DCo7RfDI4EQGdI Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 0848835ae1ee48258fafb4df0ae3ced8 Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-VolumesGetTestJSON-1829234929 Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:11:59.360002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:11:59.361027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0848835ae1ee48258fafb4df0ae3ced8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0848835ae1ee48258fafb4df0ae3ced8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0848835ae1ee48258fafb4df0ae3ced8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0848835ae1ee48258fafb4df0ae3ced8"}]}] Jun 23 17:11:59.361027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-VolumesGetTestJSON-1829234929 Jun 23 17:11:59.361027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 0848835ae1ee48258fafb4df0ae3ced8 Jun 23 17:11:59.361027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-VolumesGetTestJSON-1829234929 Jun 23 17:11:59.361027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-VolumesGetTestJSON-1829234929-project Jun 23 17:11:59.361027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:11:59.361027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:11:59.361027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: e038bb43276e413498ad02e67e34c89c Jun 23 17:11:59.361027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-VolumesGetTestJSON-1829234929-project Jun 23 17:11:59.361027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: Jun 23 17:11:59.361027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Volume 07dd8617-e35a-46c9-b75d-fbbb20f4cc19 could not be found. Jun 23 17:11:59.361027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '07dd8617-e35a-46c9-b75d-fbbb20f4cc19'} Jun 23 17:11:59.361027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07dd8617-e35a-46c9-b75d-fbbb20f4cc19 could not be found. (HTTP 404) (Request-ID: req-ac725273-fa7c-4ec5-b54a-6689c599990b) Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:11:59.361653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 17:11:59.363290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07dd8617-e35a-46c9-b75d-fbbb20f4cc19 could not be found. Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 17:11:59.364421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:11:59.365244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07dd8617-e35a-46c9-b75d-fbbb20f4cc19 could not be found. Jun 23 17:11:59.365244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:11:59.365244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:11:59.365244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:11:59.365244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:11:59.365244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:11:59.365244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:11:59.365244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:11:59.365244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:11:59.365244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07dd8617-e35a-46c9-b75d-fbbb20f4cc19 could not be found. Jun 23 17:11:59.365244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:11:59.365244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-dca30bf0-ff44-4558-a242-1e77327a7219 tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] Returning 404 to user: Volume 07dd8617-e35a-46c9-b75d-fbbb20f4cc19 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:11:59.365244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-dca30bf0-ff44-4558-a242-1e77327a7219 tempest-VolumesGetTestJSON-1829234929 tempest-VolumesGetTestJSON-1829234929-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/07dd8617-e35a-46c9-b75d-fbbb20f4cc19" status: 404 len: 109 microversion: 2.1 time: 0.095010 Jun 23 17:11:59.367348 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 23 17:11:59 2022] GET /compute/v2.1/os-volumes/07dd8617-e35a-46c9-b75d-fbbb20f4cc19 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:11:59.501535 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e8a7238a-cc9c-4f01-927c-e99b529e677f tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c6aa4e34-67a4-4904-8eea-0c16213fec83" status: 200 len: 351 microversion: 2.1 time: 0.235970 Jun 23 17:11:59.504027 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 7/14] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 23 17:11:59 2022] GET /compute/v2.1/os-volumes/c6aa4e34-67a4-4904-8eea-0c16213fec83 => generated 351 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:11:59.547241 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-655de7f2-89dc-40de-a83f-450237919841 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342fa601f0>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:11:59.614684 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-655de7f2-89dc-40de-a83f-450237919841 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc" status: 200 len: 287 microversion: 2.1 time: 0.072818 Jun 23 17:11:59.615633 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 8/15] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 23 17:11:59 2022] GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:00.627443 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bdb2dcaf-3694-4955-87fd-68be7dd10b13 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342fa5f310>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:00.680155 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bdb2dcaf-3694-4955-87fd-68be7dd10b13 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc" status: 200 len: 287 microversion: 2.1 time: 0.057008 Jun 23 17:12:00.681338 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 23 17:12:00 2022] GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:01.692848 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a1346411-b1ea-4d15-ac34-93a47a4bb05f tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342f9c5430>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:01.756844 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a1346411-b1ea-4d15-ac34-93a47a4bb05f tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc" status: 200 len: 287 microversion: 2.1 time: 0.068112 Jun 23 17:12:01.757841 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 9/17] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 23 17:12:01 2022] GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:02.774075 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fbbda439-a6f5-4153-8e79-e23bbd368a9d tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342fa4a8b0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:02.857673 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fbbda439-a6f5-4153-8e79-e23bbd368a9d tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc" status: 200 len: 287 microversion: 2.1 time: 0.091819 Jun 23 17:12:02.858861 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 9/18] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 23 17:12:02 2022] GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:03.731738 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b4a54b1a-96bf-4533-89fe-0657c2216501 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Action: 'create', calling method: .version_select at 0x7f342f9c59d0>, body: {"keypair": {"name": "tempest-keypair-1542390084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWgQccpusmwWj4VCU0pVQKjl4b/JdrYrtMcarFkE8mzYkma5nOJWMHouvqM8LaOij6MCoTe2hEGZkFIdfxowRrwnYy42W0U1LT7PaxPs9vY/bVlufvxeFKTnTpuMJQjFA=="}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:12:03.786746 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-b4a54b1a-96bf-4533-89fe-0657c2216501 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for project 201cf53eaff642e78cf394182b0b9972. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:12:03.795187 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-b4a54b1a-96bf-4533-89fe-0657c2216501 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for user fc6a4d6c1f834720a69ee30d5ae63cc9 and project 201cf53eaff642e78cf394182b0b9972. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:12:03.874769 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e0459e56-e62e-4db2-b2b6-febd031edf67 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342fa4adc0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:03.903221 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b4a54b1a-96bf-4533-89fe-0657c2216501 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.709606 Jun 23 17:12:03.906618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 10/19] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 23 17:12:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:03.927215 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e0459e56-e62e-4db2-b2b6-febd031edf67 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc" status: 200 len: 287 microversion: 2.1 time: 0.058420 Jun 23 17:12:03.927790 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 10/20] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 23 17:12:03 2022] GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:04.944461 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-265db7e4-783f-4a4a-8f2c-641a36d63319 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342f9329d0>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:05.015143 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-265db7e4-783f-4a4a-8f2c-641a36d63319 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc" status: 200 len: 287 microversion: 2.1 time: 0.078796 Jun 23 17:12:05.016684 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 11/21] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 23 17:12:04 2022] GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:05.807747 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-398051974", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "networks": [{"uuid": "b4e8f9c9-156d-4104-b1dc-aee5f43cbe07"}]}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:12:06.013931 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] validate_networks() for [('b4e8f9c9-156d-4104-b1dc-aee5f43cbe07', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:12:06.027021 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-90439cd0-05d3-482e-9b24-12c1a0adcd1e tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342f95e040>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:06.098605 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-90439cd0-05d3-482e-9b24-12c1a0adcd1e tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc" status: 200 len: 288 microversion: 2.1 time: 0.075169 Jun 23 17:12:06.099943 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 12/22] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 23 17:12:06 2022] GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc => generated 288 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:12:06.111814 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-74c8c449-0c58-460b-a10f-27ef27025274 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342f932ee0>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:06.254425 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-74c8c449-0c58-460b-a10f-27ef27025274 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc" status: 202 len: 0 microversion: 2.1 time: 0.147705 Jun 23 17:12:06.255774 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 13/23] 10.222.0.18 () {58 vars in 1253 bytes} [Thu Jun 23 17:12:06 2022] DELETE /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:12:06.276721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ef5effa0-d537-4c82-b72e-c51fb7e23906 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342f9324c0>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:06.355946 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ef5effa0-d537-4c82-b72e-c51fb7e23906 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc" status: 200 len: 287 microversion: 2.1 time: 0.095248 Jun 23 17:12:06.362620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 14/24] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 23 17:12:06 2022] GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:12:07.310878 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1072065417", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:12:07.456543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.network.neutron [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] validate_networks() for [('8527c448-8fef-4029-974e-c0de37b33eab', None, None, None, None, None)] {{(pid=117897) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:12:08.265509 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:12:08.266634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:12:08.267294 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:12:08.268301 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:12:08.269307 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:12:08.328709 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:08.331984 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:08.334617 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:08.336749 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:08.445811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Getting quotas for project 8355cfdfed4f44f689922335c2845c50. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:12:08.463587 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Getting quotas for user 41bc70e58a764f7e9e065aead58c425a and project 8355cfdfed4f44f689922335c2845c50. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:12:08.493380 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:12:08.499895 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:12:08.710231 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-38f6adb5-4fb5-4d41-9fef-b30ba207bf65 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.037703 Jun 23 17:12:08.711564 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 11/25] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:12:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:12:08.722463 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-07d26eae-8d88-4802-bf93-0b2259489591 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342f0ee1f0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:08.765909 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Flavor limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:12:08.766974 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Image limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:12:08.767668 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Flavor pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:12:08.768952 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Image pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:12:08.769590 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:12:08.779698 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-07d26eae-8d88-4802-bf93-0b2259489591 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc" status: 200 len: 287 microversion: 2.1 time: 0.066690 Jun 23 17:12:08.781222 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 12/26] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 23 17:12:08 2022] GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:08.798723 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-309289173", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3cd0a13-7d3d-4379-9bdb-f7a035d3d8b1"}], "security_groups": [{"name": "tempest-securitygroup--730691005"}], "key_name": "tempest-keypair-1542390084", "user_data": "}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:12:08.802454 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:08.803163 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:08.804237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:08.804669 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:08.954055 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Getting quotas for project bec9016d905e4d29b8e7c3f63c8a8810. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:12:08.964919 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Getting quotas for user ccfccebbea724eca8909be4fea93a58f and project bec9016d905e4d29b8e7c3f63c8a8810. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:12:08.991259 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Going to run 1 instances... {{(pid=117897) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:12:09.011486 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:12:09.047895 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] validate_networks() for [('a3cd0a13-7d3d-4379-9bdb-f7a035d3d8b1', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:12:09.187548 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-da1861f1-c9e1-4c83-acaf-4e64e316bc93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.119100 Jun 23 17:12:09.188204 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 15/27] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:12:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 17:12:09.195739 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f535e262-4077-44b8-9fae-634174b7c7aa tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:09.196387 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f535e262-4077-44b8-9fae-634174b7c7aa tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:09.431443 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f535e262-4077-44b8-9fae-634174b7c7aa tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:09.467358 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f535e262-4077-44b8-9fae-634174b7c7aa tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1214 microversion: 2.1 time: 0.277858 Jun 23 17:12:09.468027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 16/28] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:09 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1214 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:09.481903 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-94ce22ad-21b3-48b6-81f5-b701defa3af4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:09.482731 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-94ce22ad-21b3-48b6-81f5-b701defa3af4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:09.614712 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-94ce22ad-21b3-48b6-81f5-b701defa3af4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:09.624990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-94ce22ad-21b3-48b6-81f5-b701defa3af4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1222 microversion: 2.1 time: 0.154738 Jun 23 17:12:09.638222 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 17/29] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:09 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1222 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:09.725445 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1970175113", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:12:09.858912 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.network.neutron [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] validate_networks() for [('8527c448-8fef-4029-974e-c0de37b33eab', None, None, None, None, None)] {{(pid=117897) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:12:09.876132 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:12:09.876766 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:12:09.877540 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:12:09.878254 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:12:09.878879 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:12:09.890354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:09.890946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:09.892128 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:09.892780 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:09.914872 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for project 201cf53eaff642e78cf394182b0b9972. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:12:09.925571 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for user fc6a4d6c1f834720a69ee30d5ae63cc9 and project 201cf53eaff642e78cf394182b0b9972. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:12:09.943200 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:12:09.945590 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:12:10.042338 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-545eaa18-aed2-4b34-be24-e6cb3f3a6771 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.259823 Jun 23 17:12:10.043422 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 13/30] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:12:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:12:10.049162 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4fdb9d70-95b7-4e04-b23f-41c0b1ab1a22 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342f9dd160>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:10.082731 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-4fdb9d70-95b7-4e04-b23f-41c0b1ab1a22 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] HTTP exception thrown: Snapshot 7aaefda3-62a6-4984-a459-3da776e457cc could not be found. Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4fdb9d70-95b7-4e04-b23f-41c0b1ab1a22 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Request method failure captured: Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc HTTP/1.1 Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ7Ziyds9fA5Ik8_ROhGVCofK-e6GDwWedkYiFcbc2dPP6H1MP042xQnrGjD7S0cVne26vmJS45ehy2gqdDjoFrYsUmGQm56kf24VtrfavdI4QvcquRanACmXNoVuDo8i2Efc7wwnqM4kob3yYcUCw7QxTZIhxCa2nJIW9NJfmlYSPw Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: ae4929b0a6cf47ae8424685c63b0e2e6 Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-188202839 Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:12:10.088311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:12:10.089664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae4929b0a6cf47ae8424685c63b0e2e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae4929b0a6cf47ae8424685c63b0e2e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae4929b0a6cf47ae8424685c63b0e2e6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae4929b0a6cf47ae8424685c63b0e2e6"}]}] Jun 23 17:12:10.089664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-VolumesSnapshotsTestJSON-188202839 Jun 23 17:12:10.089664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: ae4929b0a6cf47ae8424685c63b0e2e6 Jun 23 17:12:10.089664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-188202839 Jun 23 17:12:10.089664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-VolumesSnapshotsTestJSON-188202839-project Jun 23 17:12:10.089664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:12:10.089664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:12:10.089664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: 38ed2481dd7b45c69593b1f3174c2c17 Jun 23 17:12:10.089664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-VolumesSnapshotsTestJSON-188202839-project Jun 23 17:12:10.089664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: Jun 23 17:12:10.089664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Snapshot 7aaefda3-62a6-4984-a459-3da776e457cc could not be found. Jun 23 17:12:10.089664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '7aaefda3-62a6-4984-a459-3da776e457cc'} Jun 23 17:12:10.089664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7aaefda3-62a6-4984-a459-3da776e457cc could not be found. (HTTP 404) (Request-ID: req-24076bc7-6002-4a85-812b-a75296d023f3) Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:12:10.090473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 17:12:10.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7aaefda3-62a6-4984-a459-3da776e457cc could not be found. Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 23 17:12:10.092598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:12:10.093719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7aaefda3-62a6-4984-a459-3da776e457cc could not be found. Jun 23 17:12:10.093719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:12:10.093719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:12:10.093719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:12:10.093719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:10.093719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:12:10.093719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:12:10.093719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:12:10.093719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:12:10.093719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7aaefda3-62a6-4984-a459-3da776e457cc could not be found. Jun 23 17:12:10.093719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:12:10.096631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4fdb9d70-95b7-4e04-b23f-41c0b1ab1a22 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Returning 404 to user: Snapshot 7aaefda3-62a6-4984-a459-3da776e457cc could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:12:10.097687 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4fdb9d70-95b7-4e04-b23f-41c0b1ab1a22 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc" status: 404 len: 111 microversion: 2.1 time: 0.053094 Jun 23 17:12:10.098675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 14/31] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 23 17:12:10 2022] GET /compute/v2.1/os-snapshots/7aaefda3-62a6-4984-a459-3da776e457cc => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:12:10.103470 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9d5b4854-07db-4b39-b449-f3a980a88cc0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:10.104253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9d5b4854-07db-4b39-b449-f3a980a88cc0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:10.330070 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9d5b4854-07db-4b39-b449-f3a980a88cc0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:10.363376 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9d5b4854-07db-4b39-b449-f3a980a88cc0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1241 microversion: 2.1 time: 0.263392 Jun 23 17:12:10.364677 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 15/32] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:10 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1241 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:10.370070 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-578275e4-85db-4370-8b0f-c5d930ea3dd0 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342e8db5e0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:10.577029 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-578275e4-85db-4370-8b0f-c5d930ea3dd0 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8" status: 202 len: 0 microversion: 2.1 time: 0.210993 Jun 23 17:12:10.578949 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 16/33] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 23 17:12:10 2022] DELETE /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:12:10.592269 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0ee9e487-5093-4b2a-b4a1-2197bb1255e8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:10.592904 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0ee9e487-5093-4b2a-b4a1-2197bb1255e8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:10.753935 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0ee9e487-5093-4b2a-b4a1-2197bb1255e8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:10.768327 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0ee9e487-5093-4b2a-b4a1-2197bb1255e8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1214 microversion: 2.1 time: 0.187254 Jun 23 17:12:10.769667 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 17/34] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:10 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:10.775481 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ccc70fa8-7377-4c15-ade8-b3a97a9ed451 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342e8db4c0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:10.902859 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ccc70fa8-7377-4c15-ade8-b3a97a9ed451 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8" status: 200 len: 345 microversion: 2.1 time: 0.131894 Jun 23 17:12:10.903693 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 18/35] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 23 17:12:10 2022] GET /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8 => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:11.286674 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6c52cdec-410e-4306-9c3d-772d70e18317 tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] Calling method '.version_select at 0x7f342e896040>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:11.472069 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6c52cdec-410e-4306-9c3d-772d70e18317 tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/369d8b8d-f9aa-459e-8d5e-0380351ed986" status: 200 len: 351 microversion: 2.1 time: 0.193191 Jun 23 17:12:11.474079 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 19/36] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 23 17:12:11 2022] GET /compute/v2.1/os-volumes/369d8b8d-f9aa-459e-8d5e-0380351ed986 => generated 351 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:11.479271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f340b346-85ea-4689-95f1-0179dce2eee4 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:11.480189 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f340b346-85ea-4689-95f1-0179dce2eee4 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:11.495511 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f340b346-85ea-4689-95f1-0179dce2eee4 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:11.499957 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f340b346-85ea-4689-95f1-0179dce2eee4 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:11.501045 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f340b346-85ea-4689-95f1-0179dce2eee4 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:11.501688 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f340b346-85ea-4689-95f1-0179dce2eee4 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:11.889625 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f340b346-85ea-4689-95f1-0179dce2eee4 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:11.933600 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f340b346-85ea-4689-95f1-0179dce2eee4 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1245 microversion: 2.1 time: 0.457971 Jun 23 17:12:11.935152 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 20/37] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:11 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1245 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:11.952928 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1705bb86-c83f-4cb5-92cf-7b0a40229f25 tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] Calling method '.version_select at 0x7f342e7f9f70>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:12.093231 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Flavor limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:12:12.093766 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Image limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:12:12.094161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Flavor pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:12:12.094617 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Image pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:12:12.095193 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:12:12.112873 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:12.113329 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:12.114173 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:12.114610 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:12.154736 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1705bb86-c83f-4cb5-92cf-7b0a40229f25 tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.216653 Jun 23 17:12:12.156161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 21/38] 10.222.0.18 () {58 vars in 1133 bytes} [Thu Jun 23 17:12:11 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:12.162995 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-246e62bf-2032-4a6c-8a2c-cbf58c4d5b9c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:12.165203 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-246e62bf-2032-4a6c-8a2c-cbf58c4d5b9c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:12.186369 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Getting quotas for project bec9016d905e4d29b8e7c3f63c8a8810. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:12:12.188027 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-246e62bf-2032-4a6c-8a2c-cbf58c4d5b9c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:12.189042 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-246e62bf-2032-4a6c-8a2c-cbf58c4d5b9c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:12.190799 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-246e62bf-2032-4a6c-8a2c-cbf58c4d5b9c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:12.191495 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-246e62bf-2032-4a6c-8a2c-cbf58c4d5b9c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:12.218090 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Getting quotas for user ccfccebbea724eca8909be4fea93a58f and project bec9016d905e4d29b8e7c3f63c8a8810. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:12:12.254761 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Going to run 1 instances... {{(pid=117897) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:12:12.256997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:12:12.362036 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b94a00e7-eac3-4220-9f67-724d88bba46d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.642911 Jun 23 17:12:12.365695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 18/39] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:12:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:12:12.373125 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ab7fb44d-57d3-442f-91e3-41a1a3b67dfd tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342e0309d0>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:12.443242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-ab7fb44d-57d3-442f-91e3-41a1a3b67dfd tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] HTTP exception thrown: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ab7fb44d-57d3-442f-91e3-41a1a3b67dfd tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Request method failure captured: Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8 HTTP/1.1 Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7Ziyds9fA5Ik8_ROhGVCofK-e6GDwWedkYiFcbc2dPP6H1MP042xQnrGjD7S0cVne26vmJS45ehy2gqdDjoFrYsUmGQm56kf24VtrfavdI4QvcquRanACmXNoVuDo8i2Efc7wwnqM4kob3yYcUCw7QxTZIhxCa2nJIW9NJfmlYSPw Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: ae4929b0a6cf47ae8424685c63b0e2e6 Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-188202839 Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:12:12.445593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:12:12.446999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae4929b0a6cf47ae8424685c63b0e2e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae4929b0a6cf47ae8424685c63b0e2e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae4929b0a6cf47ae8424685c63b0e2e6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae4929b0a6cf47ae8424685c63b0e2e6"}]}] Jun 23 17:12:12.446999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-VolumesSnapshotsTestJSON-188202839 Jun 23 17:12:12.446999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: ae4929b0a6cf47ae8424685c63b0e2e6 Jun 23 17:12:12.446999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-188202839 Jun 23 17:12:12.446999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-VolumesSnapshotsTestJSON-188202839-project Jun 23 17:12:12.446999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:12:12.446999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:12:12.446999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 38ed2481dd7b45c69593b1f3174c2c17 Jun 23 17:12:12.446999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-VolumesSnapshotsTestJSON-188202839-project Jun 23 17:12:12.446999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: Jun 23 17:12:12.446999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.446999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '1efb4909-daa6-4c2b-81d4-b358ae6607c8'} Jun 23 17:12:12.446999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. (HTTP 404) (Request-ID: req-a7aabd3f-c5f2-48f1-8c57-6c39bdcda943) Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:12:12.447803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 17:12:12.448918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 17:12:12.450089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:12:12.451268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.451268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.451268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:12:12.451268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.451268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:12.451268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:12:12.451268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:12:12.451268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:12:12.451268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:12:12.451268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.451268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.451268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ab7fb44d-57d3-442f-91e3-41a1a3b67dfd tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Returning 404 to user: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:12:12.451268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ab7fb44d-57d3-442f-91e3-41a1a3b67dfd tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8" status: 404 len: 109 microversion: 2.1 time: 0.081938 Jun 23 17:12:12.460175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 19/40] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 23 17:12:12 2022] GET /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:12:12.471080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-246e62bf-2032-4a6c-8a2c-cbf58c4d5b9c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:12.486624 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-246e62bf-2032-4a6c-8a2c-cbf58c4d5b9c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1210 microversion: 2.1 time: 0.328706 Jun 23 17:12:12.488132 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-73f0bfcb-92f2-4ddf-8f3e-e5186d5d3856 tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] Calling method '.version_select at 0x7f342f0af700>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:12.489785 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 22/41] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:12 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1210 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:12.507802 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-27eb6794-da0e-43f2-b6a7-42523221ff45 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:12.511718 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-27eb6794-da0e-43f2-b6a7-42523221ff45 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:12.601239 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-73f0bfcb-92f2-4ddf-8f3e-e5186d5d3856 tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.139636 Jun 23 17:12:12.602242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 20/42] 10.222.0.18 () {58 vars in 1148 bytes} [Thu Jun 23 17:12:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:12.626925 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-99758337-4161-49ca-9c5f-6f03223c78aa tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342f0d1ee0>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:12.637892 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-27eb6794-da0e-43f2-b6a7-42523221ff45 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:12.656485 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-27eb6794-da0e-43f2-b6a7-42523221ff45 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1222 microversion: 2.1 time: 0.165014 Jun 23 17:12:12.657080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 23/43] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:12 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1222 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:12.674804 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-99758337-4161-49ca-9c5f-6f03223c78aa tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] HTTP exception thrown: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-99758337-4161-49ca-9c5f-6f03223c78aa tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Request method failure captured: Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: DELETE /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8 HTTP/1.1 Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7Ziyds9fA5Ik8_ROhGVCofK-e6GDwWedkYiFcbc2dPP6H1MP042xQnrGjD7S0cVne26vmJS45ehy2gqdDjoFrYsUmGQm56kf24VtrfavdI4QvcquRanACmXNoVuDo8i2Efc7wwnqM4kob3yYcUCw7QxTZIhxCa2nJIW9NJfmlYSPw Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: ae4929b0a6cf47ae8424685c63b0e2e6 Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-188202839 Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:12:12.676721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:12:12.678054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae4929b0a6cf47ae8424685c63b0e2e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae4929b0a6cf47ae8424685c63b0e2e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae4929b0a6cf47ae8424685c63b0e2e6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae4929b0a6cf47ae8424685c63b0e2e6"}]}] Jun 23 17:12:12.678054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-VolumesSnapshotsTestJSON-188202839 Jun 23 17:12:12.678054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: ae4929b0a6cf47ae8424685c63b0e2e6 Jun 23 17:12:12.678054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-188202839 Jun 23 17:12:12.678054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-VolumesSnapshotsTestJSON-188202839-project Jun 23 17:12:12.678054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:12:12.678054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:12:12.678054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 38ed2481dd7b45c69593b1f3174c2c17 Jun 23 17:12:12.678054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-VolumesSnapshotsTestJSON-188202839-project Jun 23 17:12:12.678054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: Jun 23 17:12:12.678054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.678054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '1efb4909-daa6-4c2b-81d4-b358ae6607c8'} Jun 23 17:12:12.678054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. (HTTP 404) (Request-ID: req-52a592d7-eb0c-49bc-ad7f-9aec2c75411f) Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:12:12.678839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 17:12:12.679976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 17:12:12.681134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:12:12.682185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.682185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.682185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:12:12.682185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.682185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:12.682185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:12:12.682185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:12:12.682185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:12:12.682185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:12:12.682185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.682185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.682185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-99758337-4161-49ca-9c5f-6f03223c78aa tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Returning 404 to user: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:12:12.682971 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f853a427-ebbe-401c-8270-df5d81ab75a3 tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] Calling method '.version_select at 0x7f342e814700>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:12.683065 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-99758337-4161-49ca-9c5f-6f03223c78aa tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8" status: 404 len: 109 microversion: 2.1 time: 0.058691 Jun 23 17:12:12.683065 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 21/44] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 23 17:12:12 2022] DELETE /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:12:12.686559 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f2736049-7632-48ad-b365-3b1bb99a40d4 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Calling method '.version_select at 0x7f342e03bb80>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:12.780678 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-f2736049-7632-48ad-b365-3b1bb99a40d4 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] HTTP exception thrown: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f2736049-7632-48ad-b365-3b1bb99a40d4 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Request method failure captured: Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8 HTTP/1.1 Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7Ziyds9fA5Ik8_ROhGVCofK-e6GDwWedkYiFcbc2dPP6H1MP042xQnrGjD7S0cVne26vmJS45ehy2gqdDjoFrYsUmGQm56kf24VtrfavdI4QvcquRanACmXNoVuDo8i2Efc7wwnqM4kob3yYcUCw7QxTZIhxCa2nJIW9NJfmlYSPw Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: ae4929b0a6cf47ae8424685c63b0e2e6 Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-188202839 Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:12:12.784540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:12:12.786095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae4929b0a6cf47ae8424685c63b0e2e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae4929b0a6cf47ae8424685c63b0e2e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae4929b0a6cf47ae8424685c63b0e2e6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae4929b0a6cf47ae8424685c63b0e2e6"}]}] Jun 23 17:12:12.786095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-VolumesSnapshotsTestJSON-188202839 Jun 23 17:12:12.786095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: ae4929b0a6cf47ae8424685c63b0e2e6 Jun 23 17:12:12.786095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-188202839 Jun 23 17:12:12.786095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-VolumesSnapshotsTestJSON-188202839-project Jun 23 17:12:12.786095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:12:12.786095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:12:12.786095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 38ed2481dd7b45c69593b1f3174c2c17 Jun 23 17:12:12.786095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-VolumesSnapshotsTestJSON-188202839-project Jun 23 17:12:12.786095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: Jun 23 17:12:12.786095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.786095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '1efb4909-daa6-4c2b-81d4-b358ae6607c8'} Jun 23 17:12:12.786095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. (HTTP 404) (Request-ID: req-a1d8e593-78d2-4847-bdd3-970af30ed542) Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:12:12.786990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 17:12:12.788057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 17:12:12.789039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:12:12.790015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.790015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.790015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:12:12.790015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.790015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:12:12.790015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:12:12.790015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:12:12.790015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:12:12.790015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:12:12.790015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. Jun 23 17:12:12.790015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:12:12.791376 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f2736049-7632-48ad-b365-3b1bb99a40d4 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] Returning 404 to user: Volume 1efb4909-daa6-4c2b-81d4-b358ae6607c8 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:12:12.792397 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f2736049-7632-48ad-b365-3b1bb99a40d4 tempest-VolumesSnapshotsTestJSON-188202839 tempest-VolumesSnapshotsTestJSON-188202839-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8" status: 404 len: 109 microversion: 2.1 time: 0.109548 Jun 23 17:12:12.793109 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 22/45] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 23 17:12:12 2022] GET /compute/v2.1/os-volumes/1efb4909-daa6-4c2b-81d4-b358ae6607c8 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 17:12:12.905672 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f853a427-ebbe-401c-8270-df5d81ab75a3 tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.232944 Jun 23 17:12:12.906512 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 24/46] 10.222.0.18 () {58 vars in 1133 bytes} [Thu Jun 23 17:12:12 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:12.918718 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5fc0b9d6-0efb-40ba-af8a-3c8e5da162f4 tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] Calling method '.version_select at 0x7f342e0303a0>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:12.958121 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-002584d4-5381-45c5-aa7c-83deda2a097d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:12.958788 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-002584d4-5381-45c5-aa7c-83deda2a097d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:12.977260 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-002584d4-5381-45c5-aa7c-83deda2a097d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:12.979037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-002584d4-5381-45c5-aa7c-83deda2a097d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:12.982802 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-002584d4-5381-45c5-aa7c-83deda2a097d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:12.983291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-002584d4-5381-45c5-aa7c-83deda2a097d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:13.047695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5fc0b9d6-0efb-40ba-af8a-3c8e5da162f4 tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.133018 Jun 23 17:12:13.056050 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 23/47] 10.222.0.18 () {58 vars in 1166 bytes} [Thu Jun 23 17:12:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:13.062660 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-82a650f1-8d43-41eb-b154-d2840663217d tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] Calling method '.version_select at 0x7f342f088e50>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:13.250552 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-002584d4-5381-45c5-aa7c-83deda2a097d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:13.262025 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-002584d4-5381-45c5-aa7c-83deda2a097d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1301 microversion: 2.1 time: 0.313566 Jun 23 17:12:13.276350 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:12 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1301 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:13.304706 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-82a650f1-8d43-41eb-b154-d2840663217d tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.247381 Jun 23 17:12:13.315298 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 24/49] 10.222.0.18 () {58 vars in 1169 bytes} [Thu Jun 23 17:12:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:13.320388 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fef298ed-c617-4f98-9a74-6e3875eb8f9d tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] Calling method '.version_select at 0x7f342e7a4a60>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:13.506016 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ca759c26-62fd-4d9d-9dd8-f52f4c76e43a tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:13.507087 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ca759c26-62fd-4d9d-9dd8-f52f4c76e43a tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:13.519320 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca759c26-62fd-4d9d-9dd8-f52f4c76e43a tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:13.529130 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca759c26-62fd-4d9d-9dd8-f52f4c76e43a tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:13.536122 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca759c26-62fd-4d9d-9dd8-f52f4c76e43a tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:13.540347 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca759c26-62fd-4d9d-9dd8-f52f4c76e43a tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:13.631835 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fef298ed-c617-4f98-9a74-6e3875eb8f9d tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.315326 Jun 23 17:12:13.638746 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 26/50] 10.222.0.18 () {58 vars in 1154 bytes} [Thu Jun 23 17:12:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:13.645746 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c896703b-5885-4cee-801d-9ff9659e90fa tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] Calling method '.version_select at 0x7f342e7cf040>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:14.006537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c896703b-5885-4cee-801d-9ff9659e90fa tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.366502 Jun 23 17:12:14.015243 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 27/51] 10.222.0.18 () {58 vars in 1187 bytes} [Thu Jun 23 17:12:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:12:14.015926 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d8b61234-4a91-4745-b3ed-b80e68e7ef16 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:14.016397 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d8b61234-4a91-4745-b3ed-b80e68e7ef16 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:14.063133 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8b61234-4a91-4745-b3ed-b80e68e7ef16 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:14.063604 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8b61234-4a91-4745-b3ed-b80e68e7ef16 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:14.068260 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8b61234-4a91-4745-b3ed-b80e68e7ef16 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:14.074087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8b61234-4a91-4745-b3ed-b80e68e7ef16 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:14.195187 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ca759c26-62fd-4d9d-9dd8-f52f4c76e43a tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:14.224122 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ca759c26-62fd-4d9d-9dd8-f52f4c76e43a tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1284 microversion: 2.1 time: 0.718637 Jun 23 17:12:14.235026 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 25/52] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:13 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1284 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:12:14.239226 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d83a7418-37f9-4793-a1cd-b59407a61282 tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] Calling method '.version_select at 0x7f342dfae9d0>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:14.409921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d8b61234-4a91-4745-b3ed-b80e68e7ef16 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:14.422808 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d8b61234-4a91-4745-b3ed-b80e68e7ef16 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1218 microversion: 2.1 time: 0.410500 Jun 23 17:12:14.436052 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 28/53] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:14 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1218 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:14.453672 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b626a05e-70cf-49b3-ba13-e7a61646c3c2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:14.456266 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b626a05e-70cf-49b3-ba13-e7a61646c3c2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:14.471566 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b626a05e-70cf-49b3-ba13-e7a61646c3c2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:14.472172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b626a05e-70cf-49b3-ba13-e7a61646c3c2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:14.508447 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b626a05e-70cf-49b3-ba13-e7a61646c3c2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:14.511370 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b626a05e-70cf-49b3-ba13-e7a61646c3c2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:14.547882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d83a7418-37f9-4793-a1cd-b59407a61282 tempest-VolumesTestJSON-584438792 tempest-VolumesTestJSON-584438792-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.320065 Jun 23 17:12:14.550224 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 26/54] 10.222.0.18 () {58 vars in 1154 bytes} [Thu Jun 23 17:12:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:14.863670 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b626a05e-70cf-49b3-ba13-e7a61646c3c2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:14.876775 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b626a05e-70cf-49b3-ba13-e7a61646c3c2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1299 microversion: 2.1 time: 0.429914 Jun 23 17:12:14.878084 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 29/55] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:14 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1299 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:15.246726 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9cbe0e90-d6c1-4f7b-b598-1b07ed945f22 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:15.248267 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9cbe0e90-d6c1-4f7b-b598-1b07ed945f22 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:15.264901 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9cbe0e90-d6c1-4f7b-b598-1b07ed945f22 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:15.265859 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9cbe0e90-d6c1-4f7b-b598-1b07ed945f22 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:15.269017 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9cbe0e90-d6c1-4f7b-b598-1b07ed945f22 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:15.271186 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9cbe0e90-d6c1-4f7b-b598-1b07ed945f22 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:15.445180 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-624959e3-2eb5-4923-bc78-22a7ef8e99a6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:15.446470 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-624959e3-2eb5-4923-bc78-22a7ef8e99a6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:15.457623 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-624959e3-2eb5-4923-bc78-22a7ef8e99a6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:15.460694 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-624959e3-2eb5-4923-bc78-22a7ef8e99a6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:15.462716 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-624959e3-2eb5-4923-bc78-22a7ef8e99a6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:15.466420 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-624959e3-2eb5-4923-bc78-22a7ef8e99a6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:15.936677 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-624959e3-2eb5-4923-bc78-22a7ef8e99a6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:15.948624 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-624959e3-2eb5-4923-bc78-22a7ef8e99a6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1292 microversion: 2.1 time: 0.509712 Jun 23 17:12:15.955458 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 30/56] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:15 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1292 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:12:15.964583 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9cbe0e90-d6c1-4f7b-b598-1b07ed945f22 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:15.973898 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4a3aa43b-fc1a-4b8e-9972-931f9a22dfb7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:15.977242 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4a3aa43b-fc1a-4b8e-9972-931f9a22dfb7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:15.994630 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9cbe0e90-d6c1-4f7b-b598-1b07ed945f22 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1272 microversion: 2.1 time: 0.755383 Jun 23 17:12:16.000452 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4a3aa43b-fc1a-4b8e-9972-931f9a22dfb7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:16.005016 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4a3aa43b-fc1a-4b8e-9972-931f9a22dfb7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:16.006074 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4a3aa43b-fc1a-4b8e-9972-931f9a22dfb7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:16.007936 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4a3aa43b-fc1a-4b8e-9972-931f9a22dfb7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:16.010302 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 27/57] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:15 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1272 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:16.271644 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4a3aa43b-fc1a-4b8e-9972-931f9a22dfb7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:16.285166 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4a3aa43b-fc1a-4b8e-9972-931f9a22dfb7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1299 microversion: 2.1 time: 0.328459 Jun 23 17:12:16.291621 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 31/58] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:15 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1299 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:16.974677 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7d1fa652-e6dd-46ad-b154-19ff4d97b857 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:16.976949 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7d1fa652-e6dd-46ad-b154-19ff4d97b857 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:16.994189 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d1fa652-e6dd-46ad-b154-19ff4d97b857 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:16.994958 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d1fa652-e6dd-46ad-b154-19ff4d97b857 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:16.995902 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d1fa652-e6dd-46ad-b154-19ff4d97b857 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:16.997157 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d1fa652-e6dd-46ad-b154-19ff4d97b857 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:17.020184 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f8ae3a36-7893-4f00-8119-1ea22516aeef tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:17.021722 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f8ae3a36-7893-4f00-8119-1ea22516aeef tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:17.041106 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8ae3a36-7893-4f00-8119-1ea22516aeef tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:17.043698 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8ae3a36-7893-4f00-8119-1ea22516aeef tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:17.047838 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8ae3a36-7893-4f00-8119-1ea22516aeef tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:17.051036 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8ae3a36-7893-4f00-8119-1ea22516aeef tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:17.352160 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f8ae3a36-7893-4f00-8119-1ea22516aeef tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:17.368805 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f8ae3a36-7893-4f00-8119-1ea22516aeef tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1272 microversion: 2.1 time: 0.353863 Jun 23 17:12:17.382356 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 32/59] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:17 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1272 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:17.397207 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ae7683e5-b524-4d54-98dd-a46b47a2fa92 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:17.402002 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ae7683e5-b524-4d54-98dd-a46b47a2fa92 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:17.419653 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae7683e5-b524-4d54-98dd-a46b47a2fa92 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:17.422057 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae7683e5-b524-4d54-98dd-a46b47a2fa92 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:17.423288 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae7683e5-b524-4d54-98dd-a46b47a2fa92 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:17.428444 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae7683e5-b524-4d54-98dd-a46b47a2fa92 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:17.548639 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7d1fa652-e6dd-46ad-b154-19ff4d97b857 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:17.574145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7d1fa652-e6dd-46ad-b154-19ff4d97b857 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1280 microversion: 2.1 time: 0.605360 Jun 23 17:12:17.589056 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 28/60] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:16 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1280 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:17.661105 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ae7683e5-b524-4d54-98dd-a46b47a2fa92 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:17.712561 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ae7683e5-b524-4d54-98dd-a46b47a2fa92 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1299 microversion: 2.1 time: 0.323707 Jun 23 17:12:17.715436 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 33/61] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:17 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1299 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:18.387146 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3990d39c-619e-4f66-832e-c6ae94d17cd1 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:18.389124 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3990d39c-619e-4f66-832e-c6ae94d17cd1 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:18.416729 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3990d39c-619e-4f66-832e-c6ae94d17cd1 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:18.421647 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3990d39c-619e-4f66-832e-c6ae94d17cd1 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:18.427462 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3990d39c-619e-4f66-832e-c6ae94d17cd1 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:18.430645 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3990d39c-619e-4f66-832e-c6ae94d17cd1 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:18.596884 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0c43aeac-e27c-479f-8b25-7efa704b2518 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:18.600075 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0c43aeac-e27c-479f-8b25-7efa704b2518 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:18.631204 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c43aeac-e27c-479f-8b25-7efa704b2518 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:18.636626 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c43aeac-e27c-479f-8b25-7efa704b2518 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:18.638283 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c43aeac-e27c-479f-8b25-7efa704b2518 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:18.639464 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c43aeac-e27c-479f-8b25-7efa704b2518 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:19.014298 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0c43aeac-e27c-479f-8b25-7efa704b2518 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:19.025335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0c43aeac-e27c-479f-8b25-7efa704b2518 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1280 microversion: 2.1 time: 0.435578 Jun 23 17:12:19.026191 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 34/62] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:18 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1280 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:19.044981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a9c0c184-94c2-4b17-bd71-70525e70ef0a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:19.047498 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a9c0c184-94c2-4b17-bd71-70525e70ef0a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:19.069479 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a9c0c184-94c2-4b17-bd71-70525e70ef0a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:19.073894 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a9c0c184-94c2-4b17-bd71-70525e70ef0a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:19.076963 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a9c0c184-94c2-4b17-bd71-70525e70ef0a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:19.078164 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a9c0c184-94c2-4b17-bd71-70525e70ef0a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:19.548921 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3990d39c-619e-4f66-832e-c6ae94d17cd1 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:19.567459 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3990d39c-619e-4f66-832e-c6ae94d17cd1 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 1.182319 Jun 23 17:12:19.569463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 29/63] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:18 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:19.780872 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a9c0c184-94c2-4b17-bd71-70525e70ef0a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:19.791641 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a9c0c184-94c2-4b17-bd71-70525e70ef0a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.763012 Jun 23 17:12:19.794705 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 35/64] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:19 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:20.046460 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4daeb83a-3cd1-4f1a-aca1-883f375160bb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:20.047253 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4daeb83a-3cd1-4f1a-aca1-883f375160bb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:20.068083 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4daeb83a-3cd1-4f1a-aca1-883f375160bb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:20.072012 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4daeb83a-3cd1-4f1a-aca1-883f375160bb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:20.078425 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4daeb83a-3cd1-4f1a-aca1-883f375160bb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:20.078791 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4daeb83a-3cd1-4f1a-aca1-883f375160bb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:20.273842 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4daeb83a-3cd1-4f1a-aca1-883f375160bb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:20.298131 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4daeb83a-3cd1-4f1a-aca1-883f375160bb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1280 microversion: 2.1 time: 0.258241 Jun 23 17:12:20.315897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 30/65] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:20 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1280 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:20.588647 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-14ac7a08-5fd0-4945-91ab-735ac95f6354 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:20.589331 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-14ac7a08-5fd0-4945-91ab-735ac95f6354 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:20.627704 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=4 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:20.637079 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-14ac7a08-5fd0-4945-91ab-735ac95f6354 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:20.652266 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-14ac7a08-5fd0-4945-91ab-735ac95f6354 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:20.653895 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-14ac7a08-5fd0-4945-91ab-735ac95f6354 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:20.659749 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-14ac7a08-5fd0-4945-91ab-735ac95f6354 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:20.812554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fd94c815-7112-4b90-a79a-46f3bad4742e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:20.816949 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fd94c815-7112-4b90-a79a-46f3bad4742e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:20.837176 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fd94c815-7112-4b90-a79a-46f3bad4742e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:20.858913 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fd94c815-7112-4b90-a79a-46f3bad4742e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:20.859936 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fd94c815-7112-4b90-a79a-46f3bad4742e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:20.860352 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fd94c815-7112-4b90-a79a-46f3bad4742e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:21.562477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-fd94c815-7112-4b90-a79a-46f3bad4742e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:21.576369 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-fd94c815-7112-4b90-a79a-46f3bad4742e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.768578 Jun 23 17:12:21.590545 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 31/66] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:20 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:12:21.595819 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d6640a49-37f0-4b4f-aa0b-ce09e137b12a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:21.600240 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d6640a49-37f0-4b4f-aa0b-ce09e137b12a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:21.614367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d6640a49-37f0-4b4f-aa0b-ce09e137b12a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:21.615068 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d6640a49-37f0-4b4f-aa0b-ce09e137b12a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:21.616002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d6640a49-37f0-4b4f-aa0b-ce09e137b12a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:21.616585 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d6640a49-37f0-4b4f-aa0b-ce09e137b12a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:22.146438 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=4 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:22.228533 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-14ac7a08-5fd0-4945-91ab-735ac95f6354 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:22.234233 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=20 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:22.247337 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-14ac7a08-5fd0-4945-91ab-735ac95f6354 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 1.660202 Jun 23 17:12:22.279795 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 36/67] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:20 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:22.380554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d6640a49-37f0-4b4f-aa0b-ce09e137b12a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:22.408915 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d6640a49-37f0-4b4f-aa0b-ce09e137b12a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.816657 Jun 23 17:12:22.414724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 32/68] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:21 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:22.605643 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-01f30675-b1b9-478d-bc7b-20a23b21ac42 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:22.606538 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-01f30675-b1b9-478d-bc7b-20a23b21ac42 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:22.641945 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-01f30675-b1b9-478d-bc7b-20a23b21ac42 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:22.642593 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-01f30675-b1b9-478d-bc7b-20a23b21ac42 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:22.643548 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-01f30675-b1b9-478d-bc7b-20a23b21ac42 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:22.650922 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-01f30675-b1b9-478d-bc7b-20a23b21ac42 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:22.651737 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=18 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:23.271416 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4e68fcef-2485-4b3f-8be3-9a28f09d6bc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:23.274870 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4e68fcef-2485-4b3f-8be3-9a28f09d6bc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:23.314536 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-01f30675-b1b9-478d-bc7b-20a23b21ac42 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:23.315561 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4e68fcef-2485-4b3f-8be3-9a28f09d6bc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:23.316891 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4e68fcef-2485-4b3f-8be3-9a28f09d6bc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:23.318599 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4e68fcef-2485-4b3f-8be3-9a28f09d6bc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:23.319255 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4e68fcef-2485-4b3f-8be3-9a28f09d6bc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:23.326639 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-01f30675-b1b9-478d-bc7b-20a23b21ac42 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.725730 Jun 23 17:12:23.327237 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 37/69] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:22 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:23.426197 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fed258b8-5781-497e-bc29-15050763105d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:23.426803 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fed258b8-5781-497e-bc29-15050763105d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:23.437972 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fed258b8-5781-497e-bc29-15050763105d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:23.438336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fed258b8-5781-497e-bc29-15050763105d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:23.448962 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fed258b8-5781-497e-bc29-15050763105d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:23.452052 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fed258b8-5781-497e-bc29-15050763105d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:24.398288 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4e68fcef-2485-4b3f-8be3-9a28f09d6bc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:24.425204 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4e68fcef-2485-4b3f-8be3-9a28f09d6bc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 1.163305 Jun 23 17:12:24.442352 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 33/70] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:23 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:24.451998 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-401269f0-f0ac-4e30-bb9f-c8246cf494c6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:24.453995 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-401269f0-f0ac-4e30-bb9f-c8246cf494c6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:24.464820 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-401269f0-f0ac-4e30-bb9f-c8246cf494c6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:24.465894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-401269f0-f0ac-4e30-bb9f-c8246cf494c6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:24.467717 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-401269f0-f0ac-4e30-bb9f-c8246cf494c6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:24.468365 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-401269f0-f0ac-4e30-bb9f-c8246cf494c6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:25.027657 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fed258b8-5781-497e-bc29-15050763105d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:25.043584 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fed258b8-5781-497e-bc29-15050763105d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 1.621607 Jun 23 17:12:25.045716 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 38/71] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:23 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:12:25.359911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-401269f0-f0ac-4e30-bb9f-c8246cf494c6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:25.390444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-401269f0-f0ac-4e30-bb9f-c8246cf494c6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.940898 Jun 23 17:12:25.395679 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 34/72] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:24 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:25.451489 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c6f3d182-c1ec-4191-b116-5090035968d9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:25.453716 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c6f3d182-c1ec-4191-b116-5090035968d9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:25.478417 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c6f3d182-c1ec-4191-b116-5090035968d9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:25.479725 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c6f3d182-c1ec-4191-b116-5090035968d9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:25.488313 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c6f3d182-c1ec-4191-b116-5090035968d9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:25.489203 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c6f3d182-c1ec-4191-b116-5090035968d9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:26.128108 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-d5303b3a-de9c-47a9-81f1-a7d2f58ef1d4 req-01376a24-f1fe-4f67-8a48-6548903bb130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b077dba-5836-45fb-a0e5-3a19c5a5c124", "tag": "8910ed54-da53-4e0c-a689-825852d3a4cf"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:12:26.171893 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d5303b3a-de9c-47a9-81f1-a7d2f58ef1d4 req-01376a24-f1fe-4f67-8a48-6548903bb130 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:26.174305 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d5303b3a-de9c-47a9-81f1-a7d2f58ef1d4 req-01376a24-f1fe-4f67-8a48-6548903bb130 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:26.278974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-d5303b3a-de9c-47a9-81f1-a7d2f58ef1d4 req-01376a24-f1fe-4f67-8a48-6548903bb130 service nova] Creating event network-changed:8910ed54-da53-4e0c-a689-825852d3a4cf for instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 on hv-cinder-83538 Jun 23 17:12:26.284170 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d5303b3a-de9c-47a9-81f1-a7d2f58ef1d4 req-01376a24-f1fe-4f67-8a48-6548903bb130 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117896) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 17:12:26.285928 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b959fcc-f8bd-400c-a3ee-463154703d8f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:26.318806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b959fcc-f8bd-400c-a3ee-463154703d8f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:26.328078 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b959fcc-f8bd-400c-a3ee-463154703d8f None None] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:26.328716 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b959fcc-f8bd-400c-a3ee-463154703d8f None None] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:26.391065 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.compute.rpcapi [None req-6b959fcc-f8bd-400c-a3ee-463154703d8f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 17:12:26.392015 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b959fcc-f8bd-400c-a3ee-463154703d8f None None] Releasing lock "compute-rpcapi-router" {{(pid=117896) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 17:12:26.445446 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6b959fcc-f8bd-400c-a3ee-463154703d8f None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.398002 Jun 23 17:12:26.451790 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 39/73] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:26.479247 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ce38b9e1-6547-4dff-b9d2-e2697873b54b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:26.486444 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ce38b9e1-6547-4dff-b9d2-e2697873b54b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:26.499252 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ce38b9e1-6547-4dff-b9d2-e2697873b54b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:26.511621 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ce38b9e1-6547-4dff-b9d2-e2697873b54b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:26.512603 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ce38b9e1-6547-4dff-b9d2-e2697873b54b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:26.515160 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ce38b9e1-6547-4dff-b9d2-e2697873b54b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:27.027358 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c6f3d182-c1ec-4191-b116-5090035968d9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:27.045874 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c6f3d182-c1ec-4191-b116-5090035968d9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 1.603762 Jun 23 17:12:27.052377 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 35/74] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:25 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:27.057352 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-0cc69bdb-c6d2-4969-944e-2723b9b9aef3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:27.081142 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-0cc69bdb-c6d2-4969-944e-2723b9b9aef3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:27.109252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0cc69bdb-c6d2-4969-944e-2723b9b9aef3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:27.119891 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0cc69bdb-c6d2-4969-944e-2723b9b9aef3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:27.121062 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0cc69bdb-c6d2-4969-944e-2723b9b9aef3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:27.121703 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0cc69bdb-c6d2-4969-944e-2723b9b9aef3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:27.426682 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ce38b9e1-6547-4dff-b9d2-e2697873b54b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:27.462710 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ce38b9e1-6547-4dff-b9d2-e2697873b54b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 1.007182 Jun 23 17:12:27.475946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 40/75] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:26 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:27.594099 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-0cc69bdb-c6d2-4969-944e-2723b9b9aef3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:27.605080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-0cc69bdb-c6d2-4969-944e-2723b9b9aef3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.551466 Jun 23 17:12:27.606955 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 36/76] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:27 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:28.064911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3eabd198-e39f-4f3e-bd8a-bcf3bc5ea0a2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:28.066506 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3eabd198-e39f-4f3e-bd8a-bcf3bc5ea0a2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:28.074336 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3eabd198-e39f-4f3e-bd8a-bcf3bc5ea0a2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:28.075049 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3eabd198-e39f-4f3e-bd8a-bcf3bc5ea0a2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:28.076279 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3eabd198-e39f-4f3e-bd8a-bcf3bc5ea0a2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:28.077006 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3eabd198-e39f-4f3e-bd8a-bcf3bc5ea0a2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:28.133129 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-c935db35-5fa1-410a-a939-e8e90b46d3ec req-d04545b1-1c42-4e14-b50d-62622c10be36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "517df8d9-1e33-4448-a439-8ea166866a32", "tag": "48141e67-5b25-450e-90a9-9f9ac8cb4882"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:12:28.154445 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c935db35-5fa1-410a-a939-e8e90b46d3ec req-d04545b1-1c42-4e14-b50d-62622c10be36 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:28.154888 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c935db35-5fa1-410a-a939-e8e90b46d3ec req-d04545b1-1c42-4e14-b50d-62622c10be36 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:28.171958 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:28.181285 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-c935db35-5fa1-410a-a939-e8e90b46d3ec req-d04545b1-1c42-4e14-b50d-62622c10be36 service nova] Creating event network-changed:48141e67-5b25-450e-90a9-9f9ac8cb4882 for instance 517df8d9-1e33-4448-a439-8ea166866a32 on hv-cinder-83538 Jun 23 17:12:28.191577 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-c935db35-5fa1-410a-a939-e8e90b46d3ec req-d04545b1-1c42-4e14-b50d-62622c10be36 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.722697 Jun 23 17:12:28.192178 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 41/77] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:28.396692 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3eabd198-e39f-4f3e-bd8a-bcf3bc5ea0a2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:28.421283 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3eabd198-e39f-4f3e-bd8a-bcf3bc5ea0a2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.361125 Jun 23 17:12:28.427275 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 37/78] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:28 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:28.474084 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-009cf26e-68f4-4958-8ee9-5bed75fef2ae req-8b3cd006-a352-461a-813b-d5b260e4a11f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d75741-4c24-4377-baeb-d11dc232c879", "tag": "30b1cac9-5302-4079-b5e0-7137567b16e5"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:12:28.485657 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4818525e-2f98-40ce-86d6-3bb4db6a7e6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:28.486502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4818525e-2f98-40ce-86d6-3bb4db6a7e6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:28.493408 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4818525e-2f98-40ce-86d6-3bb4db6a7e6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:28.494311 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4818525e-2f98-40ce-86d6-3bb4db6a7e6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:28.495464 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4818525e-2f98-40ce-86d6-3bb4db6a7e6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:28.496091 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4818525e-2f98-40ce-86d6-3bb4db6a7e6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:28.498844 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-009cf26e-68f4-4958-8ee9-5bed75fef2ae req-8b3cd006-a352-461a-813b-d5b260e4a11f service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:28.499285 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-009cf26e-68f4-4958-8ee9-5bed75fef2ae req-8b3cd006-a352-461a-813b-d5b260e4a11f service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:28.540067 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-009cf26e-68f4-4958-8ee9-5bed75fef2ae req-8b3cd006-a352-461a-813b-d5b260e4a11f service nova] Creating event network-changed:30b1cac9-5302-4079-b5e0-7137567b16e5 for instance c4d75741-4c24-4377-baeb-d11dc232c879 on hv-cinder-83538 Jun 23 17:12:28.551494 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-009cf26e-68f4-4958-8ee9-5bed75fef2ae req-8b3cd006-a352-461a-813b-d5b260e4a11f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082838 Jun 23 17:12:28.554838 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 42/79] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:28.628298 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a4ec7e1f-3b8e-48f0-9c00-437adb4cfcb0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:28.629254 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a4ec7e1f-3b8e-48f0-9c00-437adb4cfcb0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:28.643076 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a4ec7e1f-3b8e-48f0-9c00-437adb4cfcb0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:28.643569 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a4ec7e1f-3b8e-48f0-9c00-437adb4cfcb0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:28.644481 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a4ec7e1f-3b8e-48f0-9c00-437adb4cfcb0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:28.644883 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a4ec7e1f-3b8e-48f0-9c00-437adb4cfcb0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:28.700792 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4818525e-2f98-40ce-86d6-3bb4db6a7e6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:28.712674 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4818525e-2f98-40ce-86d6-3bb4db6a7e6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.232726 Jun 23 17:12:28.714301 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 38/80] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:28 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:12:28.949197 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a4ec7e1f-3b8e-48f0-9c00-437adb4cfcb0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:28.967754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a4ec7e1f-3b8e-48f0-9c00-437adb4cfcb0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.343393 Jun 23 17:12:28.969160 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 43/81] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:28 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:12:29.445240 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e1e7fbeb-70da-4887-bd12-c66bca3d6e82 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:29.445916 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e1e7fbeb-70da-4887-bd12-c66bca3d6e82 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:29.452978 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e1e7fbeb-70da-4887-bd12-c66bca3d6e82 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:29.452978 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e1e7fbeb-70da-4887-bd12-c66bca3d6e82 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:29.454104 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e1e7fbeb-70da-4887-bd12-c66bca3d6e82 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:29.455267 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e1e7fbeb-70da-4887-bd12-c66bca3d6e82 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:29.607828 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e1e7fbeb-70da-4887-bd12-c66bca3d6e82 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:29.616060 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e1e7fbeb-70da-4887-bd12-c66bca3d6e82 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.175197 Jun 23 17:12:29.617331 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 39/82] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:29 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:29.731520 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-90d9dd6b-94a5-4cb5-8126-78d2e7b6dcc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:29.732073 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-90d9dd6b-94a5-4cb5-8126-78d2e7b6dcc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:29.738688 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-90d9dd6b-94a5-4cb5-8126-78d2e7b6dcc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:29.739460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-90d9dd6b-94a5-4cb5-8126-78d2e7b6dcc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:29.740363 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-90d9dd6b-94a5-4cb5-8126-78d2e7b6dcc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:29.740941 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-90d9dd6b-94a5-4cb5-8126-78d2e7b6dcc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:29.956723 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-90d9dd6b-94a5-4cb5-8126-78d2e7b6dcc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:29.966702 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-90d9dd6b-94a5-4cb5-8126-78d2e7b6dcc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.239226 Jun 23 17:12:29.967866 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 44/83] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:29 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:29.990202 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a98966eb-0274-41db-a64a-a021022e5e5f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:29.990956 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a98966eb-0274-41db-a64a-a021022e5e5f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:30.004285 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a98966eb-0274-41db-a64a-a021022e5e5f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:30.006483 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a98966eb-0274-41db-a64a-a021022e5e5f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:30.007668 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a98966eb-0274-41db-a64a-a021022e5e5f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:30.008272 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a98966eb-0274-41db-a64a-a021022e5e5f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:30.201056 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a98966eb-0274-41db-a64a-a021022e5e5f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:30.212228 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a98966eb-0274-41db-a64a-a021022e5e5f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.226241 Jun 23 17:12:30.215228 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 40/84] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:29 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:30.224228 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-4ed294f6-b9a6-47f5-988f-f34377f4bbda req-1f4f1b0f-4a74-4bcc-ac9d-55c6728dd255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05cdc2c3-760e-4876-86fc-3f85c50f0a31", "tag": "3612ccfa-71a1-4cf4-800c-6c5428ab6f0e"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:12:30.233732 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-4ed294f6-b9a6-47f5-988f-f34377f4bbda req-1f4f1b0f-4a74-4bcc-ac9d-55c6728dd255 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:30.234146 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-4ed294f6-b9a6-47f5-988f-f34377f4bbda req-1f4f1b0f-4a74-4bcc-ac9d-55c6728dd255 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:30.246558 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-4ed294f6-b9a6-47f5-988f-f34377f4bbda req-1f4f1b0f-4a74-4bcc-ac9d-55c6728dd255 service nova] Creating event network-changed:3612ccfa-71a1-4cf4-800c-6c5428ab6f0e for instance 05cdc2c3-760e-4876-86fc-3f85c50f0a31 on hv-cinder-83538 Jun 23 17:12:30.250508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-4ed294f6-b9a6-47f5-988f-f34377f4bbda req-1f4f1b0f-4a74-4bcc-ac9d-55c6728dd255 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030829 Jun 23 17:12:30.251482 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 45/85] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:30.635681 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7634a89a-d001-4b0c-9071-e07df3296204 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:30.636292 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7634a89a-d001-4b0c-9071-e07df3296204 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:30.644767 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7634a89a-d001-4b0c-9071-e07df3296204 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:30.645546 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7634a89a-d001-4b0c-9071-e07df3296204 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:30.646656 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7634a89a-d001-4b0c-9071-e07df3296204 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:30.647094 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7634a89a-d001-4b0c-9071-e07df3296204 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:30.881277 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7634a89a-d001-4b0c-9071-e07df3296204 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:30.887267 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:30.891920 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7634a89a-d001-4b0c-9071-e07df3296204 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.260634 Jun 23 17:12:30.893053 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 41/86] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:30 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:30.987465 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0b0d6cea-5f68-4001-a0ea-963b2cb28193 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:30.988234 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0b0d6cea-5f68-4001-a0ea-963b2cb28193 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:30.995024 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b0d6cea-5f68-4001-a0ea-963b2cb28193 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:30.995558 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b0d6cea-5f68-4001-a0ea-963b2cb28193 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:30.996509 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b0d6cea-5f68-4001-a0ea-963b2cb28193 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:30.996996 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b0d6cea-5f68-4001-a0ea-963b2cb28193 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:31.170212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0b0d6cea-5f68-4001-a0ea-963b2cb28193 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:31.179620 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0b0d6cea-5f68-4001-a0ea-963b2cb28193 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.199872 Jun 23 17:12:31.180385 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 46/87] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:30 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:31.231781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1c23748e-1f26-4bb8-b119-56e156cd1f97 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:31.232439 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1c23748e-1f26-4bb8-b119-56e156cd1f97 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:31.239265 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1c23748e-1f26-4bb8-b119-56e156cd1f97 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:31.239713 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1c23748e-1f26-4bb8-b119-56e156cd1f97 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:31.240597 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1c23748e-1f26-4bb8-b119-56e156cd1f97 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:31.241032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1c23748e-1f26-4bb8-b119-56e156cd1f97 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:31.378891 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1c23748e-1f26-4bb8-b119-56e156cd1f97 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:31.386412 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1c23748e-1f26-4bb8-b119-56e156cd1f97 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.158518 Jun 23 17:12:31.386980 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 42/88] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:31 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:31.911784 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ae168f63-9bfc-4f88-ba71-9d7750716dc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:31.912476 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ae168f63-9bfc-4f88-ba71-9d7750716dc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:31.920426 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae168f63-9bfc-4f88-ba71-9d7750716dc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:31.920864 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae168f63-9bfc-4f88-ba71-9d7750716dc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:31.921614 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae168f63-9bfc-4f88-ba71-9d7750716dc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:31.922063 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae168f63-9bfc-4f88-ba71-9d7750716dc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:32.059940 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ae168f63-9bfc-4f88-ba71-9d7750716dc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:32.068346 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ae168f63-9bfc-4f88-ba71-9d7750716dc9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.163581 Jun 23 17:12:32.069004 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 47/89] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:31 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:32.198338 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c2629122-3041-4fea-a645-3645334fc9d6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:32.199023 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c2629122-3041-4fea-a645-3645334fc9d6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:32.205255 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c2629122-3041-4fea-a645-3645334fc9d6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:32.205678 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c2629122-3041-4fea-a645-3645334fc9d6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:32.206474 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c2629122-3041-4fea-a645-3645334fc9d6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:32.206922 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c2629122-3041-4fea-a645-3645334fc9d6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:32.355892 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c2629122-3041-4fea-a645-3645334fc9d6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:32.363654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c2629122-3041-4fea-a645-3645334fc9d6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.169135 Jun 23 17:12:32.372934 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 43/90] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:32 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:32.403341 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-097d6d4e-3695-44d1-9999-1b3e4b954fbc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:32.404028 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-097d6d4e-3695-44d1-9999-1b3e4b954fbc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:32.410464 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-097d6d4e-3695-44d1-9999-1b3e4b954fbc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:32.410898 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-097d6d4e-3695-44d1-9999-1b3e4b954fbc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:32.411832 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-097d6d4e-3695-44d1-9999-1b3e4b954fbc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:32.412396 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-097d6d4e-3695-44d1-9999-1b3e4b954fbc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:32.576835 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-097d6d4e-3695-44d1-9999-1b3e4b954fbc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:32.585908 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-097d6d4e-3695-44d1-9999-1b3e4b954fbc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.186358 Jun 23 17:12:32.586616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 48/91] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:32 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:33.085694 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-35d0b6fa-f256-409a-9f16-e8c4f0a05c25 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:33.086669 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-35d0b6fa-f256-409a-9f16-e8c4f0a05c25 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:33.096538 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-35d0b6fa-f256-409a-9f16-e8c4f0a05c25 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:33.098142 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-35d0b6fa-f256-409a-9f16-e8c4f0a05c25 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:33.098937 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-35d0b6fa-f256-409a-9f16-e8c4f0a05c25 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:33.099364 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-35d0b6fa-f256-409a-9f16-e8c4f0a05c25 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:33.382138 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7cceaadb-837b-4a7a-bb13-04ff6b83e364 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:33.382816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7cceaadb-837b-4a7a-bb13-04ff6b83e364 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:33.399122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7cceaadb-837b-4a7a-bb13-04ff6b83e364 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:33.400540 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7cceaadb-837b-4a7a-bb13-04ff6b83e364 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:33.402253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7cceaadb-837b-4a7a-bb13-04ff6b83e364 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:33.404336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7cceaadb-837b-4a7a-bb13-04ff6b83e364 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:33.423737 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-35d0b6fa-f256-409a-9f16-e8c4f0a05c25 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:33.437725 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-35d0b6fa-f256-409a-9f16-e8c4f0a05c25 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.356576 Jun 23 17:12:33.439857 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 44/92] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:33 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:12:33.606856 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c93c048a-5c63-41e6-87c3-01754a45ce02 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:33.608188 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c93c048a-5c63-41e6-87c3-01754a45ce02 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:33.616528 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:33.626720 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c93c048a-5c63-41e6-87c3-01754a45ce02 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:33.627628 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c93c048a-5c63-41e6-87c3-01754a45ce02 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:33.629988 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c93c048a-5c63-41e6-87c3-01754a45ce02 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:33.630813 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c93c048a-5c63-41e6-87c3-01754a45ce02 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:33.881761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7cceaadb-837b-4a7a-bb13-04ff6b83e364 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:33.893529 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7cceaadb-837b-4a7a-bb13-04ff6b83e364 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.516520 Jun 23 17:12:33.894503 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 49/93] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:33 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:33.947733 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c93c048a-5c63-41e6-87c3-01754a45ce02 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:33.955589 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c93c048a-5c63-41e6-87c3-01754a45ce02 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.356204 Jun 23 17:12:33.967403 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 45/94] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:33 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:12:34.456461 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-459f6eef-178c-421b-9c08-6b3ca4a62069 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:34.457301 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-459f6eef-178c-421b-9c08-6b3ca4a62069 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:34.463848 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:34.477245 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-459f6eef-178c-421b-9c08-6b3ca4a62069 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:34.478097 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-459f6eef-178c-421b-9c08-6b3ca4a62069 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:34.478838 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-459f6eef-178c-421b-9c08-6b3ca4a62069 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:34.479771 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-459f6eef-178c-421b-9c08-6b3ca4a62069 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:34.664933 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-459f6eef-178c-421b-9c08-6b3ca4a62069 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:34.678554 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-459f6eef-178c-421b-9c08-6b3ca4a62069 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.226154 Jun 23 17:12:34.708642 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 50/95] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:34 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:34.911470 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7124c3df-f9f2-4c0e-9d5c-2cd2934b5825 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:34.912092 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7124c3df-f9f2-4c0e-9d5c-2cd2934b5825 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:34.918185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7124c3df-f9f2-4c0e-9d5c-2cd2934b5825 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:34.918686 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7124c3df-f9f2-4c0e-9d5c-2cd2934b5825 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:34.919456 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7124c3df-f9f2-4c0e-9d5c-2cd2934b5825 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:34.920317 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7124c3df-f9f2-4c0e-9d5c-2cd2934b5825 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:34.973058 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c54fa100-9101-42e9-b8ee-5b470dd0397f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:34.973764 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c54fa100-9101-42e9-b8ee-5b470dd0397f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:34.980740 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c54fa100-9101-42e9-b8ee-5b470dd0397f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:34.981388 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c54fa100-9101-42e9-b8ee-5b470dd0397f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:34.982377 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c54fa100-9101-42e9-b8ee-5b470dd0397f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:34.982905 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c54fa100-9101-42e9-b8ee-5b470dd0397f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:35.137582 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7124c3df-f9f2-4c0e-9d5c-2cd2934b5825 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:35.149057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7124c3df-f9f2-4c0e-9d5c-2cd2934b5825 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.241516 Jun 23 17:12:35.150065 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 46/96] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:34 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:35.183985 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c54fa100-9101-42e9-b8ee-5b470dd0397f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:35.192407 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c54fa100-9101-42e9-b8ee-5b470dd0397f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.223598 Jun 23 17:12:35.192990 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 51/97] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:34 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:35.703129 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-12566386-c8dd-41ed-aae8-d996c293c33e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:35.703928 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-12566386-c8dd-41ed-aae8-d996c293c33e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:35.710662 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12566386-c8dd-41ed-aae8-d996c293c33e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:35.711516 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12566386-c8dd-41ed-aae8-d996c293c33e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:35.712495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12566386-c8dd-41ed-aae8-d996c293c33e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:35.713480 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12566386-c8dd-41ed-aae8-d996c293c33e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:35.898944 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-12566386-c8dd-41ed-aae8-d996c293c33e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:35.907720 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-12566386-c8dd-41ed-aae8-d996c293c33e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.211262 Jun 23 17:12:35.918516 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 47/98] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:35 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:36.168088 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1996c576-0b4e-44b4-825f-0d6a57221b73 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:36.168712 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1996c576-0b4e-44b4-825f-0d6a57221b73 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:36.175748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1996c576-0b4e-44b4-825f-0d6a57221b73 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:36.176647 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1996c576-0b4e-44b4-825f-0d6a57221b73 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:36.178079 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1996c576-0b4e-44b4-825f-0d6a57221b73 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:36.178982 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1996c576-0b4e-44b4-825f-0d6a57221b73 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:36.210829 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-0c3fecff-8aae-4ae3-ad04-9e7a16065df0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:36.214739 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-0c3fecff-8aae-4ae3-ad04-9e7a16065df0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:36.222415 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0c3fecff-8aae-4ae3-ad04-9e7a16065df0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:36.223201 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0c3fecff-8aae-4ae3-ad04-9e7a16065df0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:36.224192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0c3fecff-8aae-4ae3-ad04-9e7a16065df0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:36.225162 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0c3fecff-8aae-4ae3-ad04-9e7a16065df0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:36.370312 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1996c576-0b4e-44b4-825f-0d6a57221b73 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:36.379898 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:36.387045 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1996c576-0b4e-44b4-825f-0d6a57221b73 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.223559 Jun 23 17:12:36.387626 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 52/99] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:36 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:36.433198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-0c3fecff-8aae-4ae3-ad04-9e7a16065df0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:36.442965 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-0c3fecff-8aae-4ae3-ad04-9e7a16065df0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.236755 Jun 23 17:12:36.443825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 48/100] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:36 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:36.928023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-28fe6eb3-b422-4b5c-bada-8f86486dec44 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:36.928023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-28fe6eb3-b422-4b5c-bada-8f86486dec44 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:36.932530 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28fe6eb3-b422-4b5c-bada-8f86486dec44 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:36.932962 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28fe6eb3-b422-4b5c-bada-8f86486dec44 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:36.933718 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28fe6eb3-b422-4b5c-bada-8f86486dec44 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:36.934137 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28fe6eb3-b422-4b5c-bada-8f86486dec44 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:37.079373 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-28fe6eb3-b422-4b5c-bada-8f86486dec44 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:37.088152 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-28fe6eb3-b422-4b5c-bada-8f86486dec44 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.167167 Jun 23 17:12:37.088767 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 53/101] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:36 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:37.403954 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ee73ba80-6676-4def-8ab0-0803759036dd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:37.404702 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ee73ba80-6676-4def-8ab0-0803759036dd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:37.413030 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ee73ba80-6676-4def-8ab0-0803759036dd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:37.413467 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ee73ba80-6676-4def-8ab0-0803759036dd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:37.414509 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ee73ba80-6676-4def-8ab0-0803759036dd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:37.414946 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ee73ba80-6676-4def-8ab0-0803759036dd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:37.459512 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0d29658a-133d-4966-8e50-e43b62e36c1d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:37.460836 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0d29658a-133d-4966-8e50-e43b62e36c1d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:37.467444 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d29658a-133d-4966-8e50-e43b62e36c1d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:37.468159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d29658a-133d-4966-8e50-e43b62e36c1d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:37.469269 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d29658a-133d-4966-8e50-e43b62e36c1d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:37.470049 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d29658a-133d-4966-8e50-e43b62e36c1d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:37.594432 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ee73ba80-6676-4def-8ab0-0803759036dd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:37.602443 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ee73ba80-6676-4def-8ab0-0803759036dd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.202473 Jun 23 17:12:37.612298 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 49/102] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:37 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:37.624558 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0d29658a-133d-4966-8e50-e43b62e36c1d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:37.632797 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0d29658a-133d-4966-8e50-e43b62e36c1d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.177209 Jun 23 17:12:37.633531 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 54/103] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:37 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:38.105846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e047052f-fb73-4c6b-9b1a-bcf19e79a098 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:38.106622 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e047052f-fb73-4c6b-9b1a-bcf19e79a098 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:38.114667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e047052f-fb73-4c6b-9b1a-bcf19e79a098 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:38.115188 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e047052f-fb73-4c6b-9b1a-bcf19e79a098 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:38.115977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e047052f-fb73-4c6b-9b1a-bcf19e79a098 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:38.116576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e047052f-fb73-4c6b-9b1a-bcf19e79a098 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:38.283425 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e047052f-fb73-4c6b-9b1a-bcf19e79a098 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:38.293893 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e047052f-fb73-4c6b-9b1a-bcf19e79a098 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.191783 Jun 23 17:12:38.293893 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 50/104] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:38 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:38.619609 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-45ca32c8-18ab-4991-88b9-f408dfdb6e05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:38.620947 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-45ca32c8-18ab-4991-88b9-f408dfdb6e05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:38.635540 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-45ca32c8-18ab-4991-88b9-f408dfdb6e05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:38.636182 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-45ca32c8-18ab-4991-88b9-f408dfdb6e05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:38.636995 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-45ca32c8-18ab-4991-88b9-f408dfdb6e05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:38.637439 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-45ca32c8-18ab-4991-88b9-f408dfdb6e05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:38.651073 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-47c89fb1-53b1-42a0-a0eb-b6b697137031 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:38.652412 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-47c89fb1-53b1-42a0-a0eb-b6b697137031 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:38.659248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-47c89fb1-53b1-42a0-a0eb-b6b697137031 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:38.659902 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-47c89fb1-53b1-42a0-a0eb-b6b697137031 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:38.660975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-47c89fb1-53b1-42a0-a0eb-b6b697137031 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:38.661564 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-47c89fb1-53b1-42a0-a0eb-b6b697137031 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:38.838383 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-45ca32c8-18ab-4991-88b9-f408dfdb6e05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:38.840428 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-47c89fb1-53b1-42a0-a0eb-b6b697137031 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:38.848789 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-45ca32c8-18ab-4991-88b9-f408dfdb6e05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.233084 Jun 23 17:12:38.851369 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-47c89fb1-53b1-42a0-a0eb-b6b697137031 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.205323 Jun 23 17:12:38.861087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 55/105] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:38 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:38.862697 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 51/106] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:38 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:39.308266 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4acda528-2548-4026-be25-22b6730f9573 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:39.309024 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4acda528-2548-4026-be25-22b6730f9573 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:39.318884 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4acda528-2548-4026-be25-22b6730f9573 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:39.319321 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4acda528-2548-4026-be25-22b6730f9573 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:39.320089 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4acda528-2548-4026-be25-22b6730f9573 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:39.320512 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4acda528-2548-4026-be25-22b6730f9573 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:39.485190 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4acda528-2548-4026-be25-22b6730f9573 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:39.492864 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4acda528-2548-4026-be25-22b6730f9573 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.188396 Jun 23 17:12:39.493439 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 56/107] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:39 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:39.868754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3607e747-2560-4a80-8352-f309a89cd457 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:39.869439 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3607e747-2560-4a80-8352-f309a89cd457 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:39.869696 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-59dced75-2722-46ed-8c01-a5515e7f9ea3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:39.870353 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-59dced75-2722-46ed-8c01-a5515e7f9ea3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:39.876292 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3607e747-2560-4a80-8352-f309a89cd457 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:39.876733 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3607e747-2560-4a80-8352-f309a89cd457 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:39.877499 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3607e747-2560-4a80-8352-f309a89cd457 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:39.877951 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-59dced75-2722-46ed-8c01-a5515e7f9ea3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:39.878327 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-59dced75-2722-46ed-8c01-a5515e7f9ea3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:39.879303 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-59dced75-2722-46ed-8c01-a5515e7f9ea3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:39.879742 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-59dced75-2722-46ed-8c01-a5515e7f9ea3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:39.879840 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3607e747-2560-4a80-8352-f309a89cd457 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:40.033209 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-59dced75-2722-46ed-8c01-a5515e7f9ea3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:40.045402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-59dced75-2722-46ed-8c01-a5515e7f9ea3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.180802 Jun 23 17:12:40.055923 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 52/108] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:39 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:40.064894 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3607e747-2560-4a80-8352-f309a89cd457 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:40.074094 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3607e747-2560-4a80-8352-f309a89cd457 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.209167 Jun 23 17:12:40.074764 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 57/109] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:39 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:40.510223 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-69763c82-ae6c-4ae8-a408-e5044493a834 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:40.510906 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-69763c82-ae6c-4ae8-a408-e5044493a834 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:40.521760 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-69763c82-ae6c-4ae8-a408-e5044493a834 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:40.521760 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-69763c82-ae6c-4ae8-a408-e5044493a834 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:40.521760 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-69763c82-ae6c-4ae8-a408-e5044493a834 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:40.521760 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-69763c82-ae6c-4ae8-a408-e5044493a834 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:40.665520 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-69763c82-ae6c-4ae8-a408-e5044493a834 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:40.673557 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-69763c82-ae6c-4ae8-a408-e5044493a834 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.167721 Jun 23 17:12:40.674151 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 53/110] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:40 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:41.063242 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d3188a32-907f-4766-b96f-5c11e49d59fe tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:41.064254 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d3188a32-907f-4766-b96f-5c11e49d59fe tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:41.070785 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3188a32-907f-4766-b96f-5c11e49d59fe tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:41.071178 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3188a32-907f-4766-b96f-5c11e49d59fe tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:41.071949 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3188a32-907f-4766-b96f-5c11e49d59fe tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:41.072432 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3188a32-907f-4766-b96f-5c11e49d59fe tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:41.091681 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9a9c3b9f-dd88-419f-a9b6-eae6765a308b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:41.093489 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9a9c3b9f-dd88-419f-a9b6-eae6765a308b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:41.106153 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9a9c3b9f-dd88-419f-a9b6-eae6765a308b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:41.106688 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9a9c3b9f-dd88-419f-a9b6-eae6765a308b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:41.108057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9a9c3b9f-dd88-419f-a9b6-eae6765a308b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:41.110313 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9a9c3b9f-dd88-419f-a9b6-eae6765a308b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:41.343188 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d3188a32-907f-4766-b96f-5c11e49d59fe tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:41.348765 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9a9c3b9f-dd88-419f-a9b6-eae6765a308b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:41.351435 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d3188a32-907f-4766-b96f-5c11e49d59fe tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.292042 Jun 23 17:12:41.352521 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 58/111] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:41 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:41.376192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9a9c3b9f-dd88-419f-a9b6-eae6765a308b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.287957 Jun 23 17:12:41.376755 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 54/112] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:41 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:41.691170 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ef1d0f79-d744-4257-a8fb-955fded7de34 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:41.691711 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ef1d0f79-d744-4257-a8fb-955fded7de34 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:41.698550 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef1d0f79-d744-4257-a8fb-955fded7de34 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:41.699312 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef1d0f79-d744-4257-a8fb-955fded7de34 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:41.700306 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef1d0f79-d744-4257-a8fb-955fded7de34 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:41.700806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef1d0f79-d744-4257-a8fb-955fded7de34 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:41.890369 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ef1d0f79-d744-4257-a8fb-955fded7de34 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:41.894035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:41.911480 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ef1d0f79-d744-4257-a8fb-955fded7de34 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.225305 Jun 23 17:12:41.914236 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 59/113] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:41 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:42.368129 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-74484d32-da71-4128-9de0-3faecdfe8e12 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:42.369545 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-74484d32-da71-4128-9de0-3faecdfe8e12 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:42.375397 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-74484d32-da71-4128-9de0-3faecdfe8e12 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:42.375846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-74484d32-da71-4128-9de0-3faecdfe8e12 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:42.376678 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-74484d32-da71-4128-9de0-3faecdfe8e12 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:42.377095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-74484d32-da71-4128-9de0-3faecdfe8e12 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:42.395865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f9b16966-17a8-4479-9d41-31e7fb797b4d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:42.400728 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f9b16966-17a8-4479-9d41-31e7fb797b4d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:42.409038 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f9b16966-17a8-4479-9d41-31e7fb797b4d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:42.409772 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f9b16966-17a8-4479-9d41-31e7fb797b4d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:42.413877 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f9b16966-17a8-4479-9d41-31e7fb797b4d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:42.414483 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f9b16966-17a8-4479-9d41-31e7fb797b4d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:42.535873 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-74484d32-da71-4128-9de0-3faecdfe8e12 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:42.553595 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-74484d32-da71-4128-9de0-3faecdfe8e12 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.179557 Jun 23 17:12:42.553595 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 55/114] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:42 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:42.588396 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f9b16966-17a8-4479-9d41-31e7fb797b4d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:42.598876 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f9b16966-17a8-4479-9d41-31e7fb797b4d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.208926 Jun 23 17:12:42.599895 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 60/115] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:42 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:42.931695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-bc53ba43-f3ea-42a1-aa42-6af0cecf40f3 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:42.932305 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-bc53ba43-f3ea-42a1-aa42-6af0cecf40f3 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:42.939183 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bc53ba43-f3ea-42a1-aa42-6af0cecf40f3 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:42.939751 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bc53ba43-f3ea-42a1-aa42-6af0cecf40f3 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:42.940384 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bc53ba43-f3ea-42a1-aa42-6af0cecf40f3 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:42.940812 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bc53ba43-f3ea-42a1-aa42-6af0cecf40f3 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:43.070776 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-bc53ba43-f3ea-42a1-aa42-6af0cecf40f3 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:43.078468 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-bc53ba43-f3ea-42a1-aa42-6af0cecf40f3 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.151006 Jun 23 17:12:43.079075 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 56/116] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:42 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:43.561471 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e684c862-28cf-455d-9fa4-b3a3e0e420dd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:43.562073 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e684c862-28cf-455d-9fa4-b3a3e0e420dd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:43.568814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e684c862-28cf-455d-9fa4-b3a3e0e420dd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:43.569246 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e684c862-28cf-455d-9fa4-b3a3e0e420dd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:43.570011 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e684c862-28cf-455d-9fa4-b3a3e0e420dd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:43.570439 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e684c862-28cf-455d-9fa4-b3a3e0e420dd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:43.616806 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-857f56b8-e627-4b58-8bfd-a83190c9a45a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:43.617408 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-857f56b8-e627-4b58-8bfd-a83190c9a45a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:43.623641 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-857f56b8-e627-4b58-8bfd-a83190c9a45a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:43.624085 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-857f56b8-e627-4b58-8bfd-a83190c9a45a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:43.624851 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-857f56b8-e627-4b58-8bfd-a83190c9a45a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:43.625281 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-857f56b8-e627-4b58-8bfd-a83190c9a45a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:43.717533 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e684c862-28cf-455d-9fa4-b3a3e0e420dd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:43.726060 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e684c862-28cf-455d-9fa4-b3a3e0e420dd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.168303 Jun 23 17:12:43.726645 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 61/117] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:43 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:43.795732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-857f56b8-e627-4b58-8bfd-a83190c9a45a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:43.803353 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-857f56b8-e627-4b58-8bfd-a83190c9a45a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.190484 Jun 23 17:12:43.803909 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 57/118] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:43 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:44.095721 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-39571203-3a34-4215-a713-4b04b5555bb4 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:44.096287 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-39571203-3a34-4215-a713-4b04b5555bb4 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:44.102508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-39571203-3a34-4215-a713-4b04b5555bb4 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:44.102945 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-39571203-3a34-4215-a713-4b04b5555bb4 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:44.103707 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-39571203-3a34-4215-a713-4b04b5555bb4 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:44.104158 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-39571203-3a34-4215-a713-4b04b5555bb4 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:44.239001 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-39571203-3a34-4215-a713-4b04b5555bb4 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:44.247157 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-39571203-3a34-4215-a713-4b04b5555bb4 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.155402 Jun 23 17:12:44.247730 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 62/119] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:44 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:44.743176 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-75cbccf8-214d-4983-bc1a-88c4bf21d2d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:44.743827 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-75cbccf8-214d-4983-bc1a-88c4bf21d2d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:44.750178 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-75cbccf8-214d-4983-bc1a-88c4bf21d2d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:44.750795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-75cbccf8-214d-4983-bc1a-88c4bf21d2d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:44.751617 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-75cbccf8-214d-4983-bc1a-88c4bf21d2d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:44.752104 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-75cbccf8-214d-4983-bc1a-88c4bf21d2d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:44.772615 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:44.821581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-003bcac2-6f0a-4354-ac2b-9b5e3cfa1a6d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:44.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-003bcac2-6f0a-4354-ac2b-9b5e3cfa1a6d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:44.831597 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-003bcac2-6f0a-4354-ac2b-9b5e3cfa1a6d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:44.832361 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-003bcac2-6f0a-4354-ac2b-9b5e3cfa1a6d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:44.833498 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-003bcac2-6f0a-4354-ac2b-9b5e3cfa1a6d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:44.834166 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-003bcac2-6f0a-4354-ac2b-9b5e3cfa1a6d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:44.906451 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-75cbccf8-214d-4983-bc1a-88c4bf21d2d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:44.918453 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-75cbccf8-214d-4983-bc1a-88c4bf21d2d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.178832 Jun 23 17:12:44.919515 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 58/120] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:44 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:12:44.997941 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-003bcac2-6f0a-4354-ac2b-9b5e3cfa1a6d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:45.006316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-003bcac2-6f0a-4354-ac2b-9b5e3cfa1a6d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.189539 Jun 23 17:12:45.006740 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 63/121] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:44 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:12:45.265049 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-16909e2d-b285-4c31-b2f9-41969342f3e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:45.265560 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-16909e2d-b285-4c31-b2f9-41969342f3e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:45.272175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-16909e2d-b285-4c31-b2f9-41969342f3e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:45.272622 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-16909e2d-b285-4c31-b2f9-41969342f3e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:45.273377 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-16909e2d-b285-4c31-b2f9-41969342f3e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:45.273840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-16909e2d-b285-4c31-b2f9-41969342f3e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:45.407113 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-16909e2d-b285-4c31-b2f9-41969342f3e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:45.415208 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-16909e2d-b285-4c31-b2f9-41969342f3e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.154215 Jun 23 17:12:45.415773 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 59/122] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:45 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:45.936129 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5b1c407f-0462-42fc-af96-dd876d93df38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:45.936765 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5b1c407f-0462-42fc-af96-dd876d93df38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:45.943604 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5b1c407f-0462-42fc-af96-dd876d93df38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:45.944053 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5b1c407f-0462-42fc-af96-dd876d93df38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:45.944808 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5b1c407f-0462-42fc-af96-dd876d93df38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:45.945235 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5b1c407f-0462-42fc-af96-dd876d93df38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:46.023849 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9212cabe-f407-4152-b5ff-1a523eb5c0a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:46.024470 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9212cabe-f407-4152-b5ff-1a523eb5c0a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:46.030751 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9212cabe-f407-4152-b5ff-1a523eb5c0a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:46.031190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9212cabe-f407-4152-b5ff-1a523eb5c0a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:46.032306 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9212cabe-f407-4152-b5ff-1a523eb5c0a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:46.032848 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9212cabe-f407-4152-b5ff-1a523eb5c0a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:46.096190 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5b1c407f-0462-42fc-af96-dd876d93df38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:46.107331 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5b1c407f-0462-42fc-af96-dd876d93df38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.175047 Jun 23 17:12:46.107904 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 64/123] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:45 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:46.178671 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9212cabe-f407-4152-b5ff-1a523eb5c0a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:46.187576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9212cabe-f407-4152-b5ff-1a523eb5c0a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.167850 Jun 23 17:12:46.188438 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 60/124] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:46 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:46.434389 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-71529347-bb35-412c-ad26-fd12b6d54723 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:46.435058 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-71529347-bb35-412c-ad26-fd12b6d54723 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:46.444052 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-71529347-bb35-412c-ad26-fd12b6d54723 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:46.444635 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-71529347-bb35-412c-ad26-fd12b6d54723 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:46.445636 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-71529347-bb35-412c-ad26-fd12b6d54723 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:46.446245 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-71529347-bb35-412c-ad26-fd12b6d54723 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:46.592776 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-71529347-bb35-412c-ad26-fd12b6d54723 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:46.600751 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-71529347-bb35-412c-ad26-fd12b6d54723 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.171746 Jun 23 17:12:46.601414 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 65/125] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:46 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:47.125494 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ce990dcf-ae16-4a00-83fa-c145cfd48e53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:47.126374 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ce990dcf-ae16-4a00-83fa-c145cfd48e53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:47.151423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ce990dcf-ae16-4a00-83fa-c145cfd48e53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:47.151876 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ce990dcf-ae16-4a00-83fa-c145cfd48e53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:47.152822 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ce990dcf-ae16-4a00-83fa-c145cfd48e53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:47.153267 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ce990dcf-ae16-4a00-83fa-c145cfd48e53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:47.216013 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-12656156-052c-4294-aef3-ac6b3104f659 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:47.217247 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-12656156-052c-4294-aef3-ac6b3104f659 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:47.226504 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-12656156-052c-4294-aef3-ac6b3104f659 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:47.227327 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-12656156-052c-4294-aef3-ac6b3104f659 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:47.228327 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-12656156-052c-4294-aef3-ac6b3104f659 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:47.229098 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-12656156-052c-4294-aef3-ac6b3104f659 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:47.334896 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ce990dcf-ae16-4a00-83fa-c145cfd48e53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:47.353645 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ce990dcf-ae16-4a00-83fa-c145cfd48e53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.231809 Jun 23 17:12:47.354965 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 61/126] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:47 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:47.422830 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-12656156-052c-4294-aef3-ac6b3104f659 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:47.430947 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-12656156-052c-4294-aef3-ac6b3104f659 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.220223 Jun 23 17:12:47.443412 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 66/127] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:47 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:47.617464 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ddf60d5e-22de-4bba-8711-74d4ce35a8e8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:47.618111 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ddf60d5e-22de-4bba-8711-74d4ce35a8e8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:47.625878 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ddf60d5e-22de-4bba-8711-74d4ce35a8e8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:47.626563 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ddf60d5e-22de-4bba-8711-74d4ce35a8e8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:47.627341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ddf60d5e-22de-4bba-8711-74d4ce35a8e8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:47.627810 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ddf60d5e-22de-4bba-8711-74d4ce35a8e8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:47.777907 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ddf60d5e-22de-4bba-8711-74d4ce35a8e8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:47.786690 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ddf60d5e-22de-4bba-8711-74d4ce35a8e8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.173136 Jun 23 17:12:47.787388 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 62/128] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:47 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:48.374997 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-761f712e-d494-437f-88e7-d86adfe87bd6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:48.376077 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-761f712e-d494-437f-88e7-d86adfe87bd6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:48.382685 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-761f712e-d494-437f-88e7-d86adfe87bd6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:48.383126 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-761f712e-d494-437f-88e7-d86adfe87bd6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:48.383888 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-761f712e-d494-437f-88e7-d86adfe87bd6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:48.384314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-761f712e-d494-437f-88e7-d86adfe87bd6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:48.450742 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f5e1844b-8988-46a4-8822-405f94b25c5c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:48.451444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f5e1844b-8988-46a4-8822-405f94b25c5c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:48.457695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f5e1844b-8988-46a4-8822-405f94b25c5c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:48.458172 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f5e1844b-8988-46a4-8822-405f94b25c5c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:48.458930 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f5e1844b-8988-46a4-8822-405f94b25c5c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:48.459370 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f5e1844b-8988-46a4-8822-405f94b25c5c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:48.518001 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-761f712e-d494-437f-88e7-d86adfe87bd6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:48.525818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-761f712e-d494-437f-88e7-d86adfe87bd6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.157394 Jun 23 17:12:48.526566 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 67/129] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:48 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:48.589439 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f5e1844b-8988-46a4-8822-405f94b25c5c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:48.600098 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f5e1844b-8988-46a4-8822-405f94b25c5c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.153316 Jun 23 17:12:48.600690 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 63/130] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:48 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:12:48.804354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ef9b83b8-fc74-45dd-ac84-272cd2870a1d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:48.804954 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ef9b83b8-fc74-45dd-ac84-272cd2870a1d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:48.811264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef9b83b8-fc74-45dd-ac84-272cd2870a1d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:48.811705 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef9b83b8-fc74-45dd-ac84-272cd2870a1d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:48.812451 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef9b83b8-fc74-45dd-ac84-272cd2870a1d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:48.812871 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef9b83b8-fc74-45dd-ac84-272cd2870a1d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:48.950709 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ef9b83b8-fc74-45dd-ac84-272cd2870a1d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:48.958900 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ef9b83b8-fc74-45dd-ac84-272cd2870a1d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.158617 Jun 23 17:12:48.959467 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 68/131] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:48 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:49.547890 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7501eeef-7bef-44d6-bda2-525126e1bf7a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:49.549022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7501eeef-7bef-44d6-bda2-525126e1bf7a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:49.559292 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7501eeef-7bef-44d6-bda2-525126e1bf7a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:49.560025 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7501eeef-7bef-44d6-bda2-525126e1bf7a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:49.561261 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7501eeef-7bef-44d6-bda2-525126e1bf7a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:49.562005 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7501eeef-7bef-44d6-bda2-525126e1bf7a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:49.619548 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-520d12b9-63c0-4499-b05a-b0850a8945da tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:49.620181 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-520d12b9-63c0-4499-b05a-b0850a8945da tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:49.629089 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-520d12b9-63c0-4499-b05a-b0850a8945da tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:49.629533 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-520d12b9-63c0-4499-b05a-b0850a8945da tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:49.630331 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-520d12b9-63c0-4499-b05a-b0850a8945da tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:49.630765 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-520d12b9-63c0-4499-b05a-b0850a8945da tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:49.714923 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7501eeef-7bef-44d6-bda2-525126e1bf7a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:49.723216 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7501eeef-7bef-44d6-bda2-525126e1bf7a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.181850 Jun 23 17:12:49.723792 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 64/132] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:49 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:49.772650 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-520d12b9-63c0-4499-b05a-b0850a8945da tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:49.780251 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-520d12b9-63c0-4499-b05a-b0850a8945da tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.167098 Jun 23 17:12:49.780848 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 69/133] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:49 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:49.980192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b4d9d71c-2d16-4d47-9a9b-ecffbd6cfe4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:49.981040 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b4d9d71c-2d16-4d47-9a9b-ecffbd6cfe4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:49.989833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b4d9d71c-2d16-4d47-9a9b-ecffbd6cfe4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:49.990281 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b4d9d71c-2d16-4d47-9a9b-ecffbd6cfe4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:49.991034 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b4d9d71c-2d16-4d47-9a9b-ecffbd6cfe4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:49.991457 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b4d9d71c-2d16-4d47-9a9b-ecffbd6cfe4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:50.126006 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b4d9d71c-2d16-4d47-9a9b-ecffbd6cfe4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:50.133858 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b4d9d71c-2d16-4d47-9a9b-ecffbd6cfe4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.160276 Jun 23 17:12:50.134423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 65/134] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:49 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:50.743422 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-922ed8c3-2cac-4ee1-a62b-f4d71c684cf5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:50.744413 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-922ed8c3-2cac-4ee1-a62b-f4d71c684cf5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:50.754801 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-922ed8c3-2cac-4ee1-a62b-f4d71c684cf5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:50.755505 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-922ed8c3-2cac-4ee1-a62b-f4d71c684cf5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:50.756805 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-922ed8c3-2cac-4ee1-a62b-f4d71c684cf5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:50.757473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-922ed8c3-2cac-4ee1-a62b-f4d71c684cf5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:50.796547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-78d7b91c-6251-4b26-922e-8db1b9b2fc8e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:50.797141 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-78d7b91c-6251-4b26-922e-8db1b9b2fc8e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:50.803746 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-78d7b91c-6251-4b26-922e-8db1b9b2fc8e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:50.804202 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-78d7b91c-6251-4b26-922e-8db1b9b2fc8e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:50.804967 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-78d7b91c-6251-4b26-922e-8db1b9b2fc8e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:50.805402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-78d7b91c-6251-4b26-922e-8db1b9b2fc8e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:50.889633 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-922ed8c3-2cac-4ee1-a62b-f4d71c684cf5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:50.898410 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-922ed8c3-2cac-4ee1-a62b-f4d71c684cf5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.161893 Jun 23 17:12:50.898985 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 70/135] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:50 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:51.113438 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-78d7b91c-6251-4b26-922e-8db1b9b2fc8e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:51.121448 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-78d7b91c-6251-4b26-922e-8db1b9b2fc8e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.328792 Jun 23 17:12:51.122041 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 66/136] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:50 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:51.150947 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6c6b840e-a04d-4230-bc4e-77e4c39069df tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:51.151545 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6c6b840e-a04d-4230-bc4e-77e4c39069df tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:51.157953 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6c6b840e-a04d-4230-bc4e-77e4c39069df tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:51.158496 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6c6b840e-a04d-4230-bc4e-77e4c39069df tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:51.159242 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6c6b840e-a04d-4230-bc4e-77e4c39069df tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:51.159667 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6c6b840e-a04d-4230-bc4e-77e4c39069df tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:51.306410 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6c6b840e-a04d-4230-bc4e-77e4c39069df tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:51.316229 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6c6b840e-a04d-4230-bc4e-77e4c39069df tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.169051 Jun 23 17:12:51.316811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 71/137] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:51 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:51.914650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-da79cd33-9213-42fa-b91d-c2742c5b22bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:51.915158 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-da79cd33-9213-42fa-b91d-c2742c5b22bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:51.921827 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-da79cd33-9213-42fa-b91d-c2742c5b22bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:51.922278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-da79cd33-9213-42fa-b91d-c2742c5b22bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:51.923019 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-da79cd33-9213-42fa-b91d-c2742c5b22bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:51.923444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-da79cd33-9213-42fa-b91d-c2742c5b22bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:52.061513 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-da79cd33-9213-42fa-b91d-c2742c5b22bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:52.070687 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-da79cd33-9213-42fa-b91d-c2742c5b22bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.159944 Jun 23 17:12:52.071292 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 67/138] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:51 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:52.139901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-742b20c2-93de-496c-8cd2-c3b2b4e0843d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:52.140512 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-742b20c2-93de-496c-8cd2-c3b2b4e0843d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:52.147154 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-742b20c2-93de-496c-8cd2-c3b2b4e0843d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:52.147596 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-742b20c2-93de-496c-8cd2-c3b2b4e0843d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:52.148526 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-742b20c2-93de-496c-8cd2-c3b2b4e0843d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:52.148942 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-742b20c2-93de-496c-8cd2-c3b2b4e0843d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:52.336059 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-92a6ef3a-611c-4f56-bcc9-6a18a379f85c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:52.336059 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-92a6ef3a-611c-4f56-bcc9-6a18a379f85c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:52.343856 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-92a6ef3a-611c-4f56-bcc9-6a18a379f85c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:52.344308 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-92a6ef3a-611c-4f56-bcc9-6a18a379f85c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:52.349684 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-742b20c2-93de-496c-8cd2-c3b2b4e0843d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:52.354973 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-92a6ef3a-611c-4f56-bcc9-6a18a379f85c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:52.355435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-92a6ef3a-611c-4f56-bcc9-6a18a379f85c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:52.370571 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-742b20c2-93de-496c-8cd2-c3b2b4e0843d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.230423 Jun 23 17:12:52.372875 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 72/139] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:52 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:52.509773 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-92a6ef3a-611c-4f56-bcc9-6a18a379f85c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:52.517309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-92a6ef3a-611c-4f56-bcc9-6a18a379f85c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.187840 Jun 23 17:12:52.517931 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 68/140] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:52 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:12:53.091769 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-75439078-8fa6-43e9-a075-1d48f39c4f5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:53.092813 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-75439078-8fa6-43e9-a075-1d48f39c4f5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:53.103594 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-75439078-8fa6-43e9-a075-1d48f39c4f5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:53.104328 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-75439078-8fa6-43e9-a075-1d48f39c4f5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:53.105564 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-75439078-8fa6-43e9-a075-1d48f39c4f5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:53.106325 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-75439078-8fa6-43e9-a075-1d48f39c4f5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:53.238715 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-75439078-8fa6-43e9-a075-1d48f39c4f5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:53.248999 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-75439078-8fa6-43e9-a075-1d48f39c4f5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.163594 Jun 23 17:12:53.249631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 73/141] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:53 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:53.391052 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7b60255d-6ebd-47b2-bc66-67b24306274f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:53.391901 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7b60255d-6ebd-47b2-bc66-67b24306274f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:53.402442 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7b60255d-6ebd-47b2-bc66-67b24306274f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:53.403215 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7b60255d-6ebd-47b2-bc66-67b24306274f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:53.404450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7b60255d-6ebd-47b2-bc66-67b24306274f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:53.405325 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7b60255d-6ebd-47b2-bc66-67b24306274f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:53.535621 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6dd3fc98-5714-41ba-be7a-852da5c1db21 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:53.536433 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6dd3fc98-5714-41ba-be7a-852da5c1db21 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:53.541054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7b60255d-6ebd-47b2-bc66-67b24306274f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:53.542754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6dd3fc98-5714-41ba-be7a-852da5c1db21 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:53.543372 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6dd3fc98-5714-41ba-be7a-852da5c1db21 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:53.544123 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6dd3fc98-5714-41ba-be7a-852da5c1db21 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:53.544735 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6dd3fc98-5714-41ba-be7a-852da5c1db21 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:53.548510 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7b60255d-6ebd-47b2-bc66-67b24306274f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.164136 Jun 23 17:12:53.549089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 69/142] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:53 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:53.689420 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6dd3fc98-5714-41ba-be7a-852da5c1db21 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:53.697737 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6dd3fc98-5714-41ba-be7a-852da5c1db21 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.166890 Jun 23 17:12:53.698347 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 74/143] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:53 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:54.266261 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-57c3cfd5-7dae-4d51-8744-7580ebc3d64d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:54.266915 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-57c3cfd5-7dae-4d51-8744-7580ebc3d64d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:54.273224 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57c3cfd5-7dae-4d51-8744-7580ebc3d64d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:54.273672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57c3cfd5-7dae-4d51-8744-7580ebc3d64d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:54.274461 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57c3cfd5-7dae-4d51-8744-7580ebc3d64d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:54.274891 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57c3cfd5-7dae-4d51-8744-7580ebc3d64d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:54.409437 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-57c3cfd5-7dae-4d51-8744-7580ebc3d64d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:54.417499 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-57c3cfd5-7dae-4d51-8744-7580ebc3d64d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.155467 Jun 23 17:12:54.418075 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 70/144] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:54 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:54.565270 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7ab51057-8fc1-45d5-ac33-73f8329409b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:54.565995 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7ab51057-8fc1-45d5-ac33-73f8329409b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:54.572782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7ab51057-8fc1-45d5-ac33-73f8329409b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:54.573388 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7ab51057-8fc1-45d5-ac33-73f8329409b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:54.574470 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7ab51057-8fc1-45d5-ac33-73f8329409b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:54.574868 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7ab51057-8fc1-45d5-ac33-73f8329409b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:54.715075 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-970bd4b3-c44f-45b2-8cd4-294277678f4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:54.715920 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-970bd4b3-c44f-45b2-8cd4-294277678f4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:54.722445 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-970bd4b3-c44f-45b2-8cd4-294277678f4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:54.722886 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-970bd4b3-c44f-45b2-8cd4-294277678f4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:54.723646 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-970bd4b3-c44f-45b2-8cd4-294277678f4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:54.724079 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-970bd4b3-c44f-45b2-8cd4-294277678f4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:54.796940 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7ab51057-8fc1-45d5-ac33-73f8329409b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:54.804687 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7ab51057-8fc1-45d5-ac33-73f8329409b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.244031 Jun 23 17:12:54.805265 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 75/145] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:54 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:54.854152 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-970bd4b3-c44f-45b2-8cd4-294277678f4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:54.861784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-970bd4b3-c44f-45b2-8cd4-294277678f4e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.150801 Jun 23 17:12:54.862375 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 71/146] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:54 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:55.438274 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7082f1e6-acc8-481f-a057-328856501348 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:55.439641 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7082f1e6-acc8-481f-a057-328856501348 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:55.450707 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7082f1e6-acc8-481f-a057-328856501348 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:55.451432 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7082f1e6-acc8-481f-a057-328856501348 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:55.452703 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7082f1e6-acc8-481f-a057-328856501348 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:55.453410 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7082f1e6-acc8-481f-a057-328856501348 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:55.472725 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:55.593811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7082f1e6-acc8-481f-a057-328856501348 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:55.604502 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7082f1e6-acc8-481f-a057-328856501348 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.172477 Jun 23 17:12:55.605392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 76/147] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:55 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:55.825847 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-55ce727f-aa0d-4dfa-a7fb-5c83036c1820 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:55.826885 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-55ce727f-aa0d-4dfa-a7fb-5c83036c1820 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:55.835070 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-55ce727f-aa0d-4dfa-a7fb-5c83036c1820 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:55.835521 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-55ce727f-aa0d-4dfa-a7fb-5c83036c1820 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:55.836273 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-55ce727f-aa0d-4dfa-a7fb-5c83036c1820 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:55.836703 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-55ce727f-aa0d-4dfa-a7fb-5c83036c1820 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:55.883534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a7d3a833-2550-4de6-a53a-a8a0132c46dd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:55.884104 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a7d3a833-2550-4de6-a53a-a8a0132c46dd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:55.890643 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7d3a833-2550-4de6-a53a-a8a0132c46dd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:55.891321 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7d3a833-2550-4de6-a53a-a8a0132c46dd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:55.892571 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7d3a833-2550-4de6-a53a-a8a0132c46dd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:55.892571 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7d3a833-2550-4de6-a53a-a8a0132c46dd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:56.039798 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-55ce727f-aa0d-4dfa-a7fb-5c83036c1820 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:56.047557 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-55ce727f-aa0d-4dfa-a7fb-5c83036c1820 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.228105 Jun 23 17:12:56.050179 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 72/148] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:55 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:56.091285 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a7d3a833-2550-4de6-a53a-a8a0132c46dd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:56.099468 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a7d3a833-2550-4de6-a53a-a8a0132c46dd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.219974 Jun 23 17:12:56.100043 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 77/149] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:55 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:56.624049 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-0a92e601-4380-4cdd-8118-8eb33c44b342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:56.624565 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-0a92e601-4380-4cdd-8118-8eb33c44b342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:56.631461 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0a92e601-4380-4cdd-8118-8eb33c44b342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:56.631928 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0a92e601-4380-4cdd-8118-8eb33c44b342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:56.632672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0a92e601-4380-4cdd-8118-8eb33c44b342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:56.633084 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0a92e601-4380-4cdd-8118-8eb33c44b342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:56.772311 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-0a92e601-4380-4cdd-8118-8eb33c44b342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:56.782948 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-0a92e601-4380-4cdd-8118-8eb33c44b342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.162612 Jun 23 17:12:56.783961 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 73/150] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:56 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:57.066691 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-95fbbcb1-5394-4aa7-a859-40e432785de2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:57.067294 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-95fbbcb1-5394-4aa7-a859-40e432785de2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:57.074681 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95fbbcb1-5394-4aa7-a859-40e432785de2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:57.075172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95fbbcb1-5394-4aa7-a859-40e432785de2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:57.076223 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95fbbcb1-5394-4aa7-a859-40e432785de2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:57.076700 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95fbbcb1-5394-4aa7-a859-40e432785de2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:57.117399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-13472fcf-6a55-4432-95b2-ecbcd0f170e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:57.118696 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-13472fcf-6a55-4432-95b2-ecbcd0f170e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:57.126711 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-13472fcf-6a55-4432-95b2-ecbcd0f170e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:57.127606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-13472fcf-6a55-4432-95b2-ecbcd0f170e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:57.129600 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-13472fcf-6a55-4432-95b2-ecbcd0f170e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:57.130270 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-13472fcf-6a55-4432-95b2-ecbcd0f170e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:57.226524 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-95fbbcb1-5394-4aa7-a859-40e432785de2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:57.234372 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-95fbbcb1-5394-4aa7-a859-40e432785de2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.173191 Jun 23 17:12:57.235203 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 78/151] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:57 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:57.271346 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-13472fcf-6a55-4432-95b2-ecbcd0f170e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:57.278959 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-13472fcf-6a55-4432-95b2-ecbcd0f170e6 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.165523 Jun 23 17:12:57.279617 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 74/152] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:57 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:57.803048 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ff2bbeb5-1226-470c-b7cd-cb1d1d47779a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:57.803868 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ff2bbeb5-1226-470c-b7cd-cb1d1d47779a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:57.810980 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff2bbeb5-1226-470c-b7cd-cb1d1d47779a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:57.811607 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff2bbeb5-1226-470c-b7cd-cb1d1d47779a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:57.812561 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff2bbeb5-1226-470c-b7cd-cb1d1d47779a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:57.813162 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff2bbeb5-1226-470c-b7cd-cb1d1d47779a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:57.998859 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ff2bbeb5-1226-470c-b7cd-cb1d1d47779a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:58.006558 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ff2bbeb5-1226-470c-b7cd-cb1d1d47779a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.207714 Jun 23 17:12:58.007367 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 79/153] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:57 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:58.251537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-07c19526-bc71-414d-8228-d1f084e1aff3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:58.252147 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-07c19526-bc71-414d-8228-d1f084e1aff3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:58.259151 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07c19526-bc71-414d-8228-d1f084e1aff3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:58.259607 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07c19526-bc71-414d-8228-d1f084e1aff3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:58.260434 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07c19526-bc71-414d-8228-d1f084e1aff3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:58.260864 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07c19526-bc71-414d-8228-d1f084e1aff3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:58.287549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-cb84a935-6241-49c3-a904-a3cc8a2dbf1e req-723f4b7b-53bf-454a-87c6-2e6cdeaf4071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "517df8d9-1e33-4448-a439-8ea166866a32", "name": "network-vif-plugged", "status": "completed", "tag": "48141e67-5b25-450e-90a9-9f9ac8cb4882"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:12:58.299040 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-cb84a935-6241-49c3-a904-a3cc8a2dbf1e req-723f4b7b-53bf-454a-87c6-2e6cdeaf4071 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:58.299699 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-cb84a935-6241-49c3-a904-a3cc8a2dbf1e req-723f4b7b-53bf-454a-87c6-2e6cdeaf4071 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:58.314500 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:58.324358 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-cb84a935-6241-49c3-a904-a3cc8a2dbf1e req-723f4b7b-53bf-454a-87c6-2e6cdeaf4071 service nova] Creating event network-vif-plugged:48141e67-5b25-450e-90a9-9f9ac8cb4882 for instance 517df8d9-1e33-4448-a439-8ea166866a32 on hv-cinder-83538 Jun 23 17:12:58.324958 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-cb84a935-6241-49c3-a904-a3cc8a2dbf1e req-723f4b7b-53bf-454a-87c6-2e6cdeaf4071 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117897) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 17:12:58.326528 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e0752ac8-e5be-4ef0-82a3-ab50f8997e74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:58.327120 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e0752ac8-e5be-4ef0-82a3-ab50f8997e74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:58.328049 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e0752ac8-e5be-4ef0-82a3-ab50f8997e74 None None] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:58.328633 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e0752ac8-e5be-4ef0-82a3-ab50f8997e74 None None] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:58.339451 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.compute.rpcapi [None req-e0752ac8-e5be-4ef0-82a3-ab50f8997e74 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 17:12:58.340341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e0752ac8-e5be-4ef0-82a3-ab50f8997e74 None None] Releasing lock "compute-rpcapi-router" {{(pid=117897) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 17:12:58.365257 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e0752ac8-e5be-4ef0-82a3-ab50f8997e74 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171474 Jun 23 17:12:58.366317 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 75/154] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:12:58.373167 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-28597a02-b6c3-4323-b69b-45a2e8f14bdd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:58.374140 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-28597a02-b6c3-4323-b69b-45a2e8f14bdd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:58.382816 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-28597a02-b6c3-4323-b69b-45a2e8f14bdd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:58.383473 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-28597a02-b6c3-4323-b69b-45a2e8f14bdd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:58.384486 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-28597a02-b6c3-4323-b69b-45a2e8f14bdd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:58.385310 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-28597a02-b6c3-4323-b69b-45a2e8f14bdd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:58.482494 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-07c19526-bc71-414d-8228-d1f084e1aff3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:58.490505 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-07c19526-bc71-414d-8228-d1f084e1aff3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.242850 Jun 23 17:12:58.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 80/155] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:58 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:12:58.577459 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-28597a02-b6c3-4323-b69b-45a2e8f14bdd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:58.586229 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-28597a02-b6c3-4323-b69b-45a2e8f14bdd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.218442 Jun 23 17:12:58.586926 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 76/156] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:58 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:59.028435 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d9d6f42a-f9aa-451c-8c67-6146f2613f6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:59.029137 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d9d6f42a-f9aa-451c-8c67-6146f2613f6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:59.042401 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d9d6f42a-f9aa-451c-8c67-6146f2613f6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:59.042861 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d9d6f42a-f9aa-451c-8c67-6146f2613f6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:59.043644 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d9d6f42a-f9aa-451c-8c67-6146f2613f6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:59.044078 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d9d6f42a-f9aa-451c-8c67-6146f2613f6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:59.350661 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d9d6f42a-f9aa-451c-8c67-6146f2613f6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:59.367588 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d9d6f42a-f9aa-451c-8c67-6146f2613f6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.344320 Jun 23 17:12:59.371644 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 81/157] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:59 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:12:59.512035 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-dbc13bb6-a3ae-435d-a099-d000c11ca6b5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:59.513346 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-dbc13bb6-a3ae-435d-a099-d000c11ca6b5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:59.520645 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-dbc13bb6-a3ae-435d-a099-d000c11ca6b5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:59.521400 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-dbc13bb6-a3ae-435d-a099-d000c11ca6b5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:59.522358 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-dbc13bb6-a3ae-435d-a099-d000c11ca6b5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:59.522789 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-dbc13bb6-a3ae-435d-a099-d000c11ca6b5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:59.603337 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9e2479f3-d973-4d4b-b919-9b36ac1530ad tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:12:59.611017 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9e2479f3-d973-4d4b-b919-9b36ac1530ad tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:12:59.623660 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e2479f3-d973-4d4b-b919-9b36ac1530ad tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:59.624279 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e2479f3-d973-4d4b-b919-9b36ac1530ad tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:59.625195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e2479f3-d973-4d4b-b919-9b36ac1530ad tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:12:59.625829 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e2479f3-d973-4d4b-b919-9b36ac1530ad tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:12:59.725915 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-dbc13bb6-a3ae-435d-a099-d000c11ca6b5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:12:59.735630 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-dbc13bb6-a3ae-435d-a099-d000c11ca6b5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.229104 Jun 23 17:12:59.735766 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 77/158] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:59 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:00.115565 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9e2479f3-d973-4d4b-b919-9b36ac1530ad tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:00.131854 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9e2479f3-d973-4d4b-b919-9b36ac1530ad tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.529881 Jun 23 17:13:00.132488 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 82/159] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:12:59 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:13:00.388326 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-681c50cc-da03-41b3-8252-1bee8483f2de req-dd4b53fb-8b32-413e-b3f9-6ded46a63c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d75741-4c24-4377-baeb-d11dc232c879", "name": "network-vif-plugged", "status": "completed", "tag": "30b1cac9-5302-4079-b5e0-7137567b16e5"}, {"server_uuid": "9b077dba-5836-45fb-a0e5-3a19c5a5c124", "name": "network-vif-plugged", "status": "completed", "tag": "8910ed54-da53-4e0c-a689-825852d3a4cf"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:13:00.389463 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e38f1b97-cfdb-4a29-bbae-b54d52f5ee38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:00.390103 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e38f1b97-cfdb-4a29-bbae-b54d52f5ee38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:00.400848 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e38f1b97-cfdb-4a29-bbae-b54d52f5ee38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:00.401296 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e38f1b97-cfdb-4a29-bbae-b54d52f5ee38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:00.402095 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e38f1b97-cfdb-4a29-bbae-b54d52f5ee38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:00.402528 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e38f1b97-cfdb-4a29-bbae-b54d52f5ee38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:00.405549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-681c50cc-da03-41b3-8252-1bee8483f2de req-dd4b53fb-8b32-413e-b3f9-6ded46a63c5a service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:00.406024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-681c50cc-da03-41b3-8252-1bee8483f2de req-dd4b53fb-8b32-413e-b3f9-6ded46a63c5a service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:00.425831 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-681c50cc-da03-41b3-8252-1bee8483f2de req-dd4b53fb-8b32-413e-b3f9-6ded46a63c5a service nova] Creating event network-vif-plugged:30b1cac9-5302-4079-b5e0-7137567b16e5 for instance c4d75741-4c24-4377-baeb-d11dc232c879 on hv-cinder-83538 Jun 23 17:13:00.426359 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-681c50cc-da03-41b3-8252-1bee8483f2de req-dd4b53fb-8b32-413e-b3f9-6ded46a63c5a service nova] Creating event network-vif-plugged:8910ed54-da53-4e0c-a689-825852d3a4cf for instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 on hv-cinder-83538 Jun 23 17:13:00.433988 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-681c50cc-da03-41b3-8252-1bee8483f2de req-dd4b53fb-8b32-413e-b3f9-6ded46a63c5a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050650 Jun 23 17:13:00.435068 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 78/160] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:13:00.606041 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e38f1b97-cfdb-4a29-bbae-b54d52f5ee38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:00.614669 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e38f1b97-cfdb-4a29-bbae-b54d52f5ee38 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.230208 Jun 23 17:13:00.615801 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 83/161] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:00 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:13:00.752959 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-85d5a6fd-5309-4847-9110-0620336b38fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:00.753876 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-85d5a6fd-5309-4847-9110-0620336b38fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:00.760425 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-85d5a6fd-5309-4847-9110-0620336b38fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:00.760869 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-85d5a6fd-5309-4847-9110-0620336b38fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:00.761631 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-85d5a6fd-5309-4847-9110-0620336b38fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:00.762094 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-85d5a6fd-5309-4847-9110-0620336b38fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:00.906774 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-85d5a6fd-5309-4847-9110-0620336b38fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:00.916732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-85d5a6fd-5309-4847-9110-0620336b38fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.168097 Jun 23 17:13:00.917661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 79/162] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:00 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:01.149598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c7f10089-0e16-4616-bed1-ef0e3087c00c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:01.150531 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c7f10089-0e16-4616-bed1-ef0e3087c00c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:01.157128 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7f10089-0e16-4616-bed1-ef0e3087c00c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:01.157577 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7f10089-0e16-4616-bed1-ef0e3087c00c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:01.158372 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7f10089-0e16-4616-bed1-ef0e3087c00c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:01.158806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7f10089-0e16-4616-bed1-ef0e3087c00c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:01.299513 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c7f10089-0e16-4616-bed1-ef0e3087c00c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:01.316643 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c7f10089-0e16-4616-bed1-ef0e3087c00c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.171621 Jun 23 17:13:01.317606 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 84/163] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:01 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:01.634736 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3bb66a90-3752-40d0-94b3-2d8b5b06e907 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:01.635349 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3bb66a90-3752-40d0-94b3-2d8b5b06e907 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:01.641529 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3bb66a90-3752-40d0-94b3-2d8b5b06e907 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:01.642016 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3bb66a90-3752-40d0-94b3-2d8b5b06e907 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:01.642783 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3bb66a90-3752-40d0-94b3-2d8b5b06e907 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:01.643220 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3bb66a90-3752-40d0-94b3-2d8b5b06e907 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:01.799366 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3bb66a90-3752-40d0-94b3-2d8b5b06e907 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:01.811407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3bb66a90-3752-40d0-94b3-2d8b5b06e907 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.180467 Jun 23 17:13:01.811981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 80/164] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:01 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:13:01.935839 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-948dbc91-5071-455a-9ed1-2e1b53deecaf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:01.936996 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-948dbc91-5071-455a-9ed1-2e1b53deecaf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:01.944029 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-948dbc91-5071-455a-9ed1-2e1b53deecaf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:01.944695 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-948dbc91-5071-455a-9ed1-2e1b53deecaf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:01.945475 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-948dbc91-5071-455a-9ed1-2e1b53deecaf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:01.945931 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-948dbc91-5071-455a-9ed1-2e1b53deecaf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:02.107644 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-948dbc91-5071-455a-9ed1-2e1b53deecaf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:02.118224 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-948dbc91-5071-455a-9ed1-2e1b53deecaf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.187326 Jun 23 17:13:02.128369 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 85/165] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:01 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:02.336460 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6488f6e6-8874-4353-871c-d327d9c4d959 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:02.337429 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6488f6e6-8874-4353-871c-d327d9c4d959 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:02.344298 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6488f6e6-8874-4353-871c-d327d9c4d959 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:02.344744 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6488f6e6-8874-4353-871c-d327d9c4d959 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:02.345622 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6488f6e6-8874-4353-871c-d327d9c4d959 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:02.346411 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6488f6e6-8874-4353-871c-d327d9c4d959 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:02.494932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6488f6e6-8874-4353-871c-d327d9c4d959 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:02.502622 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6488f6e6-8874-4353-871c-d327d9c4d959 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.170577 Jun 23 17:13:02.503614 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 81/166] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:02 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:02.830067 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-67af2b70-0019-46c2-af17-65289693877b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:02.831146 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-67af2b70-0019-46c2-af17-65289693877b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:02.847803 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67af2b70-0019-46c2-af17-65289693877b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:02.848647 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67af2b70-0019-46c2-af17-65289693877b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:02.849139 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67af2b70-0019-46c2-af17-65289693877b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:02.849650 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67af2b70-0019-46c2-af17-65289693877b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:03.004134 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-67af2b70-0019-46c2-af17-65289693877b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:03.018247 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-67af2b70-0019-46c2-af17-65289693877b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.188274 Jun 23 17:13:03.019094 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 86/167] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:02 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:03.136157 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-61974a54-5fcc-4ecd-a32f-9212868264d5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:03.137704 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-61974a54-5fcc-4ecd-a32f-9212868264d5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:03.144187 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-61974a54-5fcc-4ecd-a32f-9212868264d5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:03.144719 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-61974a54-5fcc-4ecd-a32f-9212868264d5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:03.145558 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-61974a54-5fcc-4ecd-a32f-9212868264d5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:03.146244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-61974a54-5fcc-4ecd-a32f-9212868264d5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:03.279344 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-61974a54-5fcc-4ecd-a32f-9212868264d5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:03.290938 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-61974a54-5fcc-4ecd-a32f-9212868264d5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.156673 Jun 23 17:13:03.290938 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 82/168] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:03 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:03.519376 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b7f4db75-0257-42af-9134-e1a4b561b79d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:03.520008 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b7f4db75-0257-42af-9134-e1a4b561b79d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:03.526275 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b7f4db75-0257-42af-9134-e1a4b561b79d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:03.526967 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b7f4db75-0257-42af-9134-e1a4b561b79d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:03.527734 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b7f4db75-0257-42af-9134-e1a4b561b79d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:03.528182 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b7f4db75-0257-42af-9134-e1a4b561b79d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:03.682418 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b7f4db75-0257-42af-9134-e1a4b561b79d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:03.697577 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b7f4db75-0257-42af-9134-e1a4b561b79d tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.179606 Jun 23 17:13:03.698553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 87/169] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:03 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:04.035749 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3f936b08-601a-4910-9d53-4a57512217fa tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:04.036356 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3f936b08-601a-4910-9d53-4a57512217fa tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:04.038413 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=76 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:04.044079 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3f936b08-601a-4910-9d53-4a57512217fa tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:04.044599 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3f936b08-601a-4910-9d53-4a57512217fa tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:04.045471 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3f936b08-601a-4910-9d53-4a57512217fa tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:04.046207 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3f936b08-601a-4910-9d53-4a57512217fa tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:04.188757 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3f936b08-601a-4910-9d53-4a57512217fa tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:04.196956 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3f936b08-601a-4910-9d53-4a57512217fa tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.165350 Jun 23 17:13:04.197778 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 83/170] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:04 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:04.304697 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c00b7a34-17af-4e9f-97d6-02add322d5cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:04.305408 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c00b7a34-17af-4e9f-97d6-02add322d5cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:04.314999 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c00b7a34-17af-4e9f-97d6-02add322d5cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:04.315746 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c00b7a34-17af-4e9f-97d6-02add322d5cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:04.316685 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c00b7a34-17af-4e9f-97d6-02add322d5cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:04.317190 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c00b7a34-17af-4e9f-97d6-02add322d5cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:04.454941 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c00b7a34-17af-4e9f-97d6-02add322d5cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:04.463252 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c00b7a34-17af-4e9f-97d6-02add322d5cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.162494 Jun 23 17:13:04.464009 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 88/171] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:04 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:04.715208 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-59bb975f-235c-4308-b0aa-625b5e2dddd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:04.715923 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-59bb975f-235c-4308-b0aa-625b5e2dddd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:04.723184 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-59bb975f-235c-4308-b0aa-625b5e2dddd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:04.723620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-59bb975f-235c-4308-b0aa-625b5e2dddd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:04.724376 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-59bb975f-235c-4308-b0aa-625b5e2dddd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:04.724801 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-59bb975f-235c-4308-b0aa-625b5e2dddd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:04.865110 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-59bb975f-235c-4308-b0aa-625b5e2dddd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:04.873161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-59bb975f-235c-4308-b0aa-625b5e2dddd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.161947 Jun 23 17:13:04.873733 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 84/172] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:04 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:05.216703 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f70c043c-1a0c-4768-8bd3-a7c2540b3686 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:05.217446 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f70c043c-1a0c-4768-8bd3-a7c2540b3686 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:05.221659 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=78 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:05.226478 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f70c043c-1a0c-4768-8bd3-a7c2540b3686 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:05.227030 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f70c043c-1a0c-4768-8bd3-a7c2540b3686 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:05.227879 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f70c043c-1a0c-4768-8bd3-a7c2540b3686 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:05.228377 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f70c043c-1a0c-4768-8bd3-a7c2540b3686 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:05.366099 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f70c043c-1a0c-4768-8bd3-a7c2540b3686 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:05.375285 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f70c043c-1a0c-4768-8bd3-a7c2540b3686 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.163008 Jun 23 17:13:05.375285 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 89/173] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:05 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:05.481641 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-2cba88b3-cc84-41ca-821d-80ead235bac8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:05.482519 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-2cba88b3-cc84-41ca-821d-80ead235bac8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:05.489430 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2cba88b3-cc84-41ca-821d-80ead235bac8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:05.490191 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2cba88b3-cc84-41ca-821d-80ead235bac8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:05.491112 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2cba88b3-cc84-41ca-821d-80ead235bac8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:05.491672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2cba88b3-cc84-41ca-821d-80ead235bac8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:05.659999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2cba88b3-cc84-41ca-821d-80ead235bac8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:05.668107 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-2cba88b3-cc84-41ca-821d-80ead235bac8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.191363 Jun 23 17:13:05.668698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 85/174] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:05 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:05.889741 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-48f9a53a-c4f3-41ea-b7cd-1686d872b1dc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:05.890379 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-48f9a53a-c4f3-41ea-b7cd-1686d872b1dc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:05.896703 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-48f9a53a-c4f3-41ea-b7cd-1686d872b1dc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:05.897145 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-48f9a53a-c4f3-41ea-b7cd-1686d872b1dc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:05.897942 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-48f9a53a-c4f3-41ea-b7cd-1686d872b1dc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:05.898534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-48f9a53a-c4f3-41ea-b7cd-1686d872b1dc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:06.052774 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-48f9a53a-c4f3-41ea-b7cd-1686d872b1dc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:06.060769 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-48f9a53a-c4f3-41ea-b7cd-1686d872b1dc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.174863 Jun 23 17:13:06.061339 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 90/175] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:05 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:06.390743 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-dba924df-9ed5-4566-af55-ddbf5f295d4b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:06.391353 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-dba924df-9ed5-4566-af55-ddbf5f295d4b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:06.397626 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-dba924df-9ed5-4566-af55-ddbf5f295d4b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:06.398112 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-dba924df-9ed5-4566-af55-ddbf5f295d4b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:06.398943 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-dba924df-9ed5-4566-af55-ddbf5f295d4b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:06.399320 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-dba924df-9ed5-4566-af55-ddbf5f295d4b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:06.532099 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-dba924df-9ed5-4566-af55-ddbf5f295d4b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:06.540505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-dba924df-9ed5-4566-af55-ddbf5f295d4b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.153555 Jun 23 17:13:06.541079 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 86/176] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:06 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:06.684642 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9ed6ca7c-844e-4f21-b35e-2ba7de51d90e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:06.685513 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9ed6ca7c-844e-4f21-b35e-2ba7de51d90e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:06.698424 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ed6ca7c-844e-4f21-b35e-2ba7de51d90e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:06.698864 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ed6ca7c-844e-4f21-b35e-2ba7de51d90e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:06.699640 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ed6ca7c-844e-4f21-b35e-2ba7de51d90e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:06.700080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ed6ca7c-844e-4f21-b35e-2ba7de51d90e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:06.835851 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9ed6ca7c-844e-4f21-b35e-2ba7de51d90e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:06.843204 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9ed6ca7c-844e-4f21-b35e-2ba7de51d90e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.162540 Jun 23 17:13:06.843752 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 91/177] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:06 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:07.078996 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-30ab1f7f-4fbb-4c66-a23c-c9861a3a19eb tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:07.082151 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-30ab1f7f-4fbb-4c66-a23c-c9861a3a19eb tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:07.088898 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30ab1f7f-4fbb-4c66-a23c-c9861a3a19eb tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:07.089587 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30ab1f7f-4fbb-4c66-a23c-c9861a3a19eb tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:07.090225 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30ab1f7f-4fbb-4c66-a23c-c9861a3a19eb tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:07.090766 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30ab1f7f-4fbb-4c66-a23c-c9861a3a19eb tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:07.227860 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-30ab1f7f-4fbb-4c66-a23c-c9861a3a19eb tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:07.235598 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-30ab1f7f-4fbb-4c66-a23c-c9861a3a19eb tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.160470 Jun 23 17:13:07.236194 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 87/178] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:07 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:07.558731 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3902b50e-8f4e-49f3-837c-bc1c3d4769dc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:07.559473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3902b50e-8f4e-49f3-837c-bc1c3d4769dc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:07.566600 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3902b50e-8f4e-49f3-837c-bc1c3d4769dc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:07.567044 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3902b50e-8f4e-49f3-837c-bc1c3d4769dc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:07.567824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3902b50e-8f4e-49f3-837c-bc1c3d4769dc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:07.568540 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3902b50e-8f4e-49f3-837c-bc1c3d4769dc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:07.702515 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3902b50e-8f4e-49f3-837c-bc1c3d4769dc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:07.710348 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3902b50e-8f4e-49f3-837c-bc1c3d4769dc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.155758 Jun 23 17:13:07.710932 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 92/179] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:07 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:13:07.862193 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6e3f6a0c-e859-4f24-9121-358d6df8d3c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:07.862790 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6e3f6a0c-e859-4f24-9121-358d6df8d3c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:07.869115 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e3f6a0c-e859-4f24-9121-358d6df8d3c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:07.869562 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e3f6a0c-e859-4f24-9121-358d6df8d3c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:07.870351 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e3f6a0c-e859-4f24-9121-358d6df8d3c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:07.870784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e3f6a0c-e859-4f24-9121-358d6df8d3c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:08.005468 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6e3f6a0c-e859-4f24-9121-358d6df8d3c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:08.013304 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6e3f6a0c-e859-4f24-9121-358d6df8d3c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.156554 Jun 23 17:13:08.013899 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 88/180] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:07 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:08.252635 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cf856bd3-4076-4586-9d0e-f9a227ee3047 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:08.253271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cf856bd3-4076-4586-9d0e-f9a227ee3047 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:08.259388 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf856bd3-4076-4586-9d0e-f9a227ee3047 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:08.259828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf856bd3-4076-4586-9d0e-f9a227ee3047 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:08.260588 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf856bd3-4076-4586-9d0e-f9a227ee3047 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:08.261009 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf856bd3-4076-4586-9d0e-f9a227ee3047 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:08.265033 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:08.401743 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-cf856bd3-4076-4586-9d0e-f9a227ee3047 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:08.409330 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cf856bd3-4076-4586-9d0e-f9a227ee3047 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.160739 Jun 23 17:13:08.409990 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 93/181] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:08 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:08.727712 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7245e2de-7719-4eaf-9624-09dca457379b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:08.728318 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7245e2de-7719-4eaf-9624-09dca457379b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:08.730340 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=2 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:08.735553 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7245e2de-7719-4eaf-9624-09dca457379b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:08.735993 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7245e2de-7719-4eaf-9624-09dca457379b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:08.736728 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7245e2de-7719-4eaf-9624-09dca457379b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:08.737507 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7245e2de-7719-4eaf-9624-09dca457379b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:08.870898 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7245e2de-7719-4eaf-9624-09dca457379b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:08.878952 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7245e2de-7719-4eaf-9624-09dca457379b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.155239 Jun 23 17:13:08.879598 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 89/182] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:08 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:09.030208 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-771d2795-3fd5-4311-9b7f-c3505e30d3c8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:09.030858 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-771d2795-3fd5-4311-9b7f-c3505e30d3c8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:09.037284 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-771d2795-3fd5-4311-9b7f-c3505e30d3c8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:09.037729 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-771d2795-3fd5-4311-9b7f-c3505e30d3c8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:09.038513 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-771d2795-3fd5-4311-9b7f-c3505e30d3c8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:09.038955 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-771d2795-3fd5-4311-9b7f-c3505e30d3c8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:09.173095 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-771d2795-3fd5-4311-9b7f-c3505e30d3c8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:09.180691 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-771d2795-3fd5-4311-9b7f-c3505e30d3c8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.154319 Jun 23 17:13:09.181260 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 94/183] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:09 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:09.428993 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5c055200-e46f-4fa5-8aba-10c85385fdf2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:09.429614 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5c055200-e46f-4fa5-8aba-10c85385fdf2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:09.436088 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5c055200-e46f-4fa5-8aba-10c85385fdf2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:09.436544 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5c055200-e46f-4fa5-8aba-10c85385fdf2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:09.437304 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5c055200-e46f-4fa5-8aba-10c85385fdf2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:09.437742 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5c055200-e46f-4fa5-8aba-10c85385fdf2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:09.582058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5c055200-e46f-4fa5-8aba-10c85385fdf2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:09.589767 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5c055200-e46f-4fa5-8aba-10c85385fdf2 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.167623 Jun 23 17:13:09.590344 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 90/184] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:09 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:09.895832 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8f2e7de2-5b3b-4eb8-8da2-2b7700b6b371 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:09.896335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8f2e7de2-5b3b-4eb8-8da2-2b7700b6b371 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:09.902317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8f2e7de2-5b3b-4eb8-8da2-2b7700b6b371 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:09.902725 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8f2e7de2-5b3b-4eb8-8da2-2b7700b6b371 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:09.903467 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8f2e7de2-5b3b-4eb8-8da2-2b7700b6b371 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:09.903920 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8f2e7de2-5b3b-4eb8-8da2-2b7700b6b371 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:10.031918 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8f2e7de2-5b3b-4eb8-8da2-2b7700b6b371 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:10.039572 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8f2e7de2-5b3b-4eb8-8da2-2b7700b6b371 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.147862 Jun 23 17:13:10.040250 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 95/185] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:09 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:10.198551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-71a89154-a8d3-4780-8240-0961eaa8d86c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:10.199853 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-71a89154-a8d3-4780-8240-0961eaa8d86c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:10.207002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71a89154-a8d3-4780-8240-0961eaa8d86c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:10.207608 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71a89154-a8d3-4780-8240-0961eaa8d86c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:10.208527 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71a89154-a8d3-4780-8240-0961eaa8d86c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:10.209108 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71a89154-a8d3-4780-8240-0961eaa8d86c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:10.341157 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-71a89154-a8d3-4780-8240-0961eaa8d86c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:10.351180 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-71a89154-a8d3-4780-8240-0961eaa8d86c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.156559 Jun 23 17:13:10.351782 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 91/186] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:10 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:10.606419 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6a2cb64f-774c-4c05-9895-dfaffb68651f tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:10.607022 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6a2cb64f-774c-4c05-9895-dfaffb68651f tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:10.613869 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6a2cb64f-774c-4c05-9895-dfaffb68651f tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:10.614314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6a2cb64f-774c-4c05-9895-dfaffb68651f tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:10.615061 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6a2cb64f-774c-4c05-9895-dfaffb68651f tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:10.615487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6a2cb64f-774c-4c05-9895-dfaffb68651f tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:10.751018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6a2cb64f-774c-4c05-9895-dfaffb68651f tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:10.761029 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6a2cb64f-774c-4c05-9895-dfaffb68651f tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.158181 Jun 23 17:13:10.761901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 96/187] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:10 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:11.059621 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e6cb113e-0c2e-497d-a213-39247303557e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:11.060452 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e6cb113e-0c2e-497d-a213-39247303557e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:11.070301 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e6cb113e-0c2e-497d-a213-39247303557e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:11.070880 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e6cb113e-0c2e-497d-a213-39247303557e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:11.072001 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e6cb113e-0c2e-497d-a213-39247303557e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:11.072586 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e6cb113e-0c2e-497d-a213-39247303557e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:11.215844 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e6cb113e-0c2e-497d-a213-39247303557e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:11.219638 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:11.225149 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e6cb113e-0c2e-497d-a213-39247303557e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.171789 Jun 23 17:13:11.225719 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 92/188] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:11 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:11.371337 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-da42980f-3e17-40ea-9e3d-b262695184b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:11.372184 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-da42980f-3e17-40ea-9e3d-b262695184b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:11.381004 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da42980f-3e17-40ea-9e3d-b262695184b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:11.381454 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da42980f-3e17-40ea-9e3d-b262695184b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:11.382253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da42980f-3e17-40ea-9e3d-b262695184b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:11.382690 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da42980f-3e17-40ea-9e3d-b262695184b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:11.517261 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-da42980f-3e17-40ea-9e3d-b262695184b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:11.524886 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-da42980f-3e17-40ea-9e3d-b262695184b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.159255 Jun 23 17:13:11.525453 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 97/189] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:11 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:11.779392 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5f89ff4c-94e7-4396-a5c8-951b6a243610 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:11.779672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5f89ff4c-94e7-4396-a5c8-951b6a243610 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:11.785929 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5f89ff4c-94e7-4396-a5c8-951b6a243610 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:11.786364 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5f89ff4c-94e7-4396-a5c8-951b6a243610 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:11.787105 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5f89ff4c-94e7-4396-a5c8-951b6a243610 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:11.787529 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5f89ff4c-94e7-4396-a5c8-951b6a243610 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:11.919937 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5f89ff4c-94e7-4396-a5c8-951b6a243610 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:11.927551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5f89ff4c-94e7-4396-a5c8-951b6a243610 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.152508 Jun 23 17:13:11.932111 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 93/190] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:11 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:12.243065 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2e99ea30-ec36-4426-b022-f542c9395991 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:12.243656 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2e99ea30-ec36-4426-b022-f542c9395991 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:12.252052 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2e99ea30-ec36-4426-b022-f542c9395991 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:12.253010 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2e99ea30-ec36-4426-b022-f542c9395991 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:12.253970 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2e99ea30-ec36-4426-b022-f542c9395991 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:12.254418 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2e99ea30-ec36-4426-b022-f542c9395991 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:12.398101 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2e99ea30-ec36-4426-b022-f542c9395991 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:12.406485 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2e99ea30-ec36-4426-b022-f542c9395991 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.167721 Jun 23 17:13:12.407296 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 98/191] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:12 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:12.546647 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6e9f4e06-c4ab-47cc-87d2-eb7039e5ff18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:12.547389 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6e9f4e06-c4ab-47cc-87d2-eb7039e5ff18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:12.556139 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e9f4e06-c4ab-47cc-87d2-eb7039e5ff18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:12.556689 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e9f4e06-c4ab-47cc-87d2-eb7039e5ff18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:12.557459 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e9f4e06-c4ab-47cc-87d2-eb7039e5ff18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:12.557917 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e9f4e06-c4ab-47cc-87d2-eb7039e5ff18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:12.636860 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-b240eec0-0ccb-495a-9656-81e14a240af6 req-bcafe171-f99a-4bab-a46c-d11eae3c031e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cdc2c3-760e-4876-86fc-3f85c50f0a31", "name": "network-vif-plugged", "status": "completed", "tag": "3612ccfa-71a1-4cf4-800c-6c5428ab6f0e"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:13:12.646502 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b240eec0-0ccb-495a-9656-81e14a240af6 req-bcafe171-f99a-4bab-a46c-d11eae3c031e service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:12.646933 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b240eec0-0ccb-495a-9656-81e14a240af6 req-bcafe171-f99a-4bab-a46c-d11eae3c031e service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:12.670730 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-b240eec0-0ccb-495a-9656-81e14a240af6 req-bcafe171-f99a-4bab-a46c-d11eae3c031e service nova] Creating event network-vif-plugged:3612ccfa-71a1-4cf4-800c-6c5428ab6f0e for instance 05cdc2c3-760e-4876-86fc-3f85c50f0a31 on hv-cinder-83538 Jun 23 17:13:12.678257 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-b240eec0-0ccb-495a-9656-81e14a240af6 req-bcafe171-f99a-4bab-a46c-d11eae3c031e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044811 Jun 23 17:13:12.680257 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 99/192] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:13:12.731146 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6e9f4e06-c4ab-47cc-87d2-eb7039e5ff18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:12.740397 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6e9f4e06-c4ab-47cc-87d2-eb7039e5ff18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.201032 Jun 23 17:13:12.741257 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 94/193] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:12 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:12.946161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f6ad6e4c-2418-44dd-bb66-ff6cc8af9bfc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:12.946901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f6ad6e4c-2418-44dd-bb66-ff6cc8af9bfc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:12.956937 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6ad6e4c-2418-44dd-bb66-ff6cc8af9bfc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:12.956937 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6ad6e4c-2418-44dd-bb66-ff6cc8af9bfc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:12.956937 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6ad6e4c-2418-44dd-bb66-ff6cc8af9bfc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:12.956937 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6ad6e4c-2418-44dd-bb66-ff6cc8af9bfc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:13.093841 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f6ad6e4c-2418-44dd-bb66-ff6cc8af9bfc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:13.102321 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f6ad6e4c-2418-44dd-bb66-ff6cc8af9bfc tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1314 microversion: 2.1 time: 0.161687 Jun 23 17:13:13.102884 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 100/194] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:12 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:13.428213 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-52ac9bff-3e10-4fe2-8029-3b03565e2022 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:13.428891 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-52ac9bff-3e10-4fe2-8029-3b03565e2022 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:13.436320 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-52ac9bff-3e10-4fe2-8029-3b03565e2022 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:13.437053 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-52ac9bff-3e10-4fe2-8029-3b03565e2022 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:13.438465 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-52ac9bff-3e10-4fe2-8029-3b03565e2022 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:13.439565 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-52ac9bff-3e10-4fe2-8029-3b03565e2022 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:13.588369 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-52ac9bff-3e10-4fe2-8029-3b03565e2022 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:13.598296 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-52ac9bff-3e10-4fe2-8029-3b03565e2022 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.174531 Jun 23 17:13:13.604901 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 95/195] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:13 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:13.757654 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-52ecf6bb-49d1-4d4f-8e77-b5865b6b14a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:13.758278 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-52ecf6bb-49d1-4d4f-8e77-b5865b6b14a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:13.764436 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-52ecf6bb-49d1-4d4f-8e77-b5865b6b14a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:13.764874 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-52ecf6bb-49d1-4d4f-8e77-b5865b6b14a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:13.765621 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-52ecf6bb-49d1-4d4f-8e77-b5865b6b14a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:13.766150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-52ecf6bb-49d1-4d4f-8e77-b5865b6b14a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:13.918293 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-52ecf6bb-49d1-4d4f-8e77-b5865b6b14a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:13.927913 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-52ecf6bb-49d1-4d4f-8e77-b5865b6b14a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.172421 Jun 23 17:13:13.928965 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 101/196] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:13 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:14.120201 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-18ee7338-8f5b-469d-b0e4-2668d0369289 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:14.120762 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-18ee7338-8f5b-469d-b0e4-2668d0369289 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:14.127399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-18ee7338-8f5b-469d-b0e4-2668d0369289 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:14.128019 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-18ee7338-8f5b-469d-b0e4-2668d0369289 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:14.128630 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-18ee7338-8f5b-469d-b0e4-2668d0369289 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:14.129296 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-18ee7338-8f5b-469d-b0e4-2668d0369289 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:14.283142 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-18ee7338-8f5b-469d-b0e4-2668d0369289 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:14.293978 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-18ee7338-8f5b-469d-b0e4-2668d0369289 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1500 microversion: 2.1 time: 0.178109 Jun 23 17:13:14.306766 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 96/197] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:14 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1500 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:13:14.616624 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a0c8284c-4bf1-4420-92bf-1adb5eb563d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:14.617227 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a0c8284c-4bf1-4420-92bf-1adb5eb563d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:14.629720 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0c8284c-4bf1-4420-92bf-1adb5eb563d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:14.631118 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0c8284c-4bf1-4420-92bf-1adb5eb563d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:14.632124 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0c8284c-4bf1-4420-92bf-1adb5eb563d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:14.633225 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0c8284c-4bf1-4420-92bf-1adb5eb563d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:14.829877 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a0c8284c-4bf1-4420-92bf-1adb5eb563d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:14.837967 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a0c8284c-4bf1-4420-92bf-1adb5eb563d6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.226461 Jun 23 17:13:14.838540 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 102/198] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:14 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:14.948828 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1cbdcdb2-89b5-4ffb-9815-ebc5b3e5ba98 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:14.949651 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1cbdcdb2-89b5-4ffb-9815-ebc5b3e5ba98 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:14.962574 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1cbdcdb2-89b5-4ffb-9815-ebc5b3e5ba98 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:14.963103 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1cbdcdb2-89b5-4ffb-9815-ebc5b3e5ba98 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:14.965851 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1cbdcdb2-89b5-4ffb-9815-ebc5b3e5ba98 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:14.965851 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1cbdcdb2-89b5-4ffb-9815-ebc5b3e5ba98 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:15.160102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1cbdcdb2-89b5-4ffb-9815-ebc5b3e5ba98 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:15.167987 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1cbdcdb2-89b5-4ffb-9815-ebc5b3e5ba98 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.224550 Jun 23 17:13:15.168564 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 97/199] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:14 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:15.858080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8b042462-f4f3-49f9-a58f-198886b1aff3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:15.859649 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8b042462-f4f3-49f9-a58f-198886b1aff3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:15.868444 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8b042462-f4f3-49f9-a58f-198886b1aff3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:15.869672 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8b042462-f4f3-49f9-a58f-198886b1aff3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:15.870423 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8b042462-f4f3-49f9-a58f-198886b1aff3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:15.871010 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8b042462-f4f3-49f9-a58f-198886b1aff3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:16.070251 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8b042462-f4f3-49f9-a58f-198886b1aff3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:16.079826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8b042462-f4f3-49f9-a58f-198886b1aff3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1366 microversion: 2.1 time: 0.226324 Jun 23 17:13:16.081209 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 103/200] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:15 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:16.187835 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4b89fb1a-d5ef-4784-82ce-52c5b209a4a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:16.202857 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4b89fb1a-d5ef-4784-82ce-52c5b209a4a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:16.214799 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4b89fb1a-d5ef-4784-82ce-52c5b209a4a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:16.215441 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4b89fb1a-d5ef-4784-82ce-52c5b209a4a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:16.216383 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4b89fb1a-d5ef-4784-82ce-52c5b209a4a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:16.216968 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4b89fb1a-d5ef-4784-82ce-52c5b209a4a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:16.435472 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4b89fb1a-d5ef-4784-82ce-52c5b209a4a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:16.446671 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4b89fb1a-d5ef-4784-82ce-52c5b209a4a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.265373 Jun 23 17:13:16.447836 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 98/201] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:16 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:16.810094 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ee391866-19aa-4eb8-9874-0e7e466d8648 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e8d370a-9a85-4d2f-a254-a1c5e8dc4b23"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:13:16.811468 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ee391866-19aa-4eb8-9874-0e7e466d8648 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:16.818328 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ee391866-19aa-4eb8-9874-0e7e466d8648 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:16.819015 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ee391866-19aa-4eb8-9874-0e7e466d8648 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:16.819959 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ee391866-19aa-4eb8-9874-0e7e466d8648 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:16.820600 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ee391866-19aa-4eb8-9874-0e7e466d8648 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:17.102848 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c87e56f4-a5a8-4d27-9a8b-ffb10af9df1a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:17.103475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c87e56f4-a5a8-4d27-9a8b-ffb10af9df1a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:17.121957 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c87e56f4-a5a8-4d27-9a8b-ffb10af9df1a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:17.122539 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c87e56f4-a5a8-4d27-9a8b-ffb10af9df1a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:17.123492 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c87e56f4-a5a8-4d27-9a8b-ffb10af9df1a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:17.124202 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c87e56f4-a5a8-4d27-9a8b-ffb10af9df1a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:17.410512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c87e56f4-a5a8-4d27-9a8b-ffb10af9df1a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:17.419663 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c87e56f4-a5a8-4d27-9a8b-ffb10af9df1a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1555 microversion: 2.1 time: 0.321577 Jun 23 17:13:17.422500 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 99/202] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:17 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1555 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:17.443987 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-aaae9efb-4df9-4a31-a1d9-d987a6a7e5ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:17.445014 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-aaae9efb-4df9-4a31-a1d9-d987a6a7e5ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:17.456657 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-aaae9efb-4df9-4a31-a1d9-d987a6a7e5ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:17.457310 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-aaae9efb-4df9-4a31-a1d9-d987a6a7e5ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:17.458507 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-aaae9efb-4df9-4a31-a1d9-d987a6a7e5ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:17.462986 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-aaae9efb-4df9-4a31-a1d9-d987a6a7e5ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:17.621277 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-aaae9efb-4df9-4a31-a1d9-d987a6a7e5ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.184290 Jun 23 17:13:17.621944 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 100/203] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 23 17:13:17 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:13:17.627247 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5429309a-7490-469f-960d-e4137e8e581d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:17.628215 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5429309a-7490-469f-960d-e4137e8e581d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:17.637960 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5429309a-7490-469f-960d-e4137e8e581d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:17.637960 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5429309a-7490-469f-960d-e4137e8e581d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:17.638850 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5429309a-7490-469f-960d-e4137e8e581d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:17.639518 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5429309a-7490-469f-960d-e4137e8e581d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:17.893037 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5429309a-7490-469f-960d-e4137e8e581d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:17.906055 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5429309a-7490-469f-960d-e4137e8e581d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1322 microversion: 2.1 time: 0.282008 Jun 23 17:13:17.909542 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 101/204] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:17 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:18.053145 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ee391866-19aa-4eb8-9874-0e7e466d8648 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "POST /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.246987 Jun 23 17:13:18.053737 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 104/205] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 23 17:13:16 2022] POST /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124/os-volume_attachments => generated 194 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:13:18.936385 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-67220ed6-7b88-4799-a3c7-9887b93fd592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:18.937158 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-67220ed6-7b88-4799-a3c7-9887b93fd592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:18.950225 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-67220ed6-7b88-4799-a3c7-9887b93fd592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:18.950763 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-67220ed6-7b88-4799-a3c7-9887b93fd592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:18.951840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-67220ed6-7b88-4799-a3c7-9887b93fd592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:18.952269 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-67220ed6-7b88-4799-a3c7-9887b93fd592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:19.168278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-67220ed6-7b88-4799-a3c7-9887b93fd592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:19.182126 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-67220ed6-7b88-4799-a3c7-9887b93fd592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1516 microversion: 2.1 time: 0.255514 Jun 23 17:13:19.196256 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 102/206] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:18 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1516 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:19.204951 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5595d321-d64c-45c2-a152-6cf8bca72d21 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:13:19.213440 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5595d321-d64c-45c2-a152-6cf8bca72d21 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:19.222384 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5595d321-d64c-45c2-a152-6cf8bca72d21 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:19.223789 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5595d321-d64c-45c2-a152-6cf8bca72d21 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:19.233247 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5595d321-d64c-45c2-a152-6cf8bca72d21 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:19.234119 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5595d321-d64c-45c2-a152-6cf8bca72d21 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:19.261261 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-5595d321-d64c-45c2-a152-6cf8bca72d21 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lazy-loading 'flavor' on Instance uuid 05cdc2c3-760e-4876-86fc-3f85c50f0a31 {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:13:19.425414 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5595d321-d64c-45c2-a152-6cf8bca72d21 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "POST /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31/action" status: 200 len: 32 microversion: 2.1 time: 0.227185 Jun 23 17:13:19.426440 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 105/207] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 23 17:13:19 2022] POST /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 17:13:19.435940 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3f8cb2b8-7b19-4306-9688-c1f734172ecc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:19.436892 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3f8cb2b8-7b19-4306-9688-c1f734172ecc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:19.446427 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3f8cb2b8-7b19-4306-9688-c1f734172ecc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:19.447553 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3f8cb2b8-7b19-4306-9688-c1f734172ecc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:19.449866 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3f8cb2b8-7b19-4306-9688-c1f734172ecc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:19.451766 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3f8cb2b8-7b19-4306-9688-c1f734172ecc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:19.636111 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-ba4ccdd3-0dd4-4451-bfbe-95c36208bff4 req-2da28c53-00f8-4a9f-8098-d4b47a0ce1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d75741-4c24-4377-baeb-d11dc232c879", "tag": "30b1cac9-5302-4079-b5e0-7137567b16e5"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:13:19.655641 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-ba4ccdd3-0dd4-4451-bfbe-95c36208bff4 req-2da28c53-00f8-4a9f-8098-d4b47a0ce1b4 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:19.662231 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-ba4ccdd3-0dd4-4451-bfbe-95c36208bff4 req-2da28c53-00f8-4a9f-8098-d4b47a0ce1b4 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:19.694340 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3f8cb2b8-7b19-4306-9688-c1f734172ecc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:19.702884 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3f8cb2b8-7b19-4306-9688-c1f734172ecc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.271174 Jun 23 17:13:19.712744 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 103/208] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:19 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:19.716682 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-ba4ccdd3-0dd4-4451-bfbe-95c36208bff4 req-2da28c53-00f8-4a9f-8098-d4b47a0ce1b4 service nova] Creating event network-changed:30b1cac9-5302-4079-b5e0-7137567b16e5 for instance c4d75741-4c24-4377-baeb-d11dc232c879 on hv-cinder-83538 Jun 23 17:13:19.730916 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-ba4ccdd3-0dd4-4451-bfbe-95c36208bff4 req-2da28c53-00f8-4a9f-8098-d4b47a0ce1b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097958 Jun 23 17:13:19.734428 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 106/209] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:13:20.722391 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-11783403-2af3-47ec-b30b-6993bb8871ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:20.724070 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-11783403-2af3-47ec-b30b-6993bb8871ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:20.734480 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-11783403-2af3-47ec-b30b-6993bb8871ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:20.734944 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-11783403-2af3-47ec-b30b-6993bb8871ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:20.735731 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-11783403-2af3-47ec-b30b-6993bb8871ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:20.736160 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-11783403-2af3-47ec-b30b-6993bb8871ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:21.152298 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-11783403-2af3-47ec-b30b-6993bb8871ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:21.162573 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-11783403-2af3-47ec-b30b-6993bb8871ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.445442 Jun 23 17:13:21.163664 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 104/210] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:20 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:22.187075 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d3242826-5a1d-499e-b567-3f176cfb7a82 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:22.197922 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d3242826-5a1d-499e-b567-3f176cfb7a82 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:22.217720 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3242826-5a1d-499e-b567-3f176cfb7a82 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:22.218504 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3242826-5a1d-499e-b567-3f176cfb7a82 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:22.222039 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3242826-5a1d-499e-b567-3f176cfb7a82 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:22.222647 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3242826-5a1d-499e-b567-3f176cfb7a82 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:22.451163 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d3242826-5a1d-499e-b567-3f176cfb7a82 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:22.455729 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:22.465719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d3242826-5a1d-499e-b567-3f176cfb7a82 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.288857 Jun 23 17:13:22.466817 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 107/211] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:22 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:23.483171 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-eb041a04-5502-421e-8b3f-53fa80c6e15d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:23.483805 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-eb041a04-5502-421e-8b3f-53fa80c6e15d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:23.505393 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eb041a04-5502-421e-8b3f-53fa80c6e15d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:23.505927 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eb041a04-5502-421e-8b3f-53fa80c6e15d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:23.506951 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eb041a04-5502-421e-8b3f-53fa80c6e15d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:23.507561 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eb041a04-5502-421e-8b3f-53fa80c6e15d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:23.547878 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-949382005", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "networks": [{"uuid": "61ebd6c3-bd7b-408e-b6a6-97ced763519b"}]}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:13:23.605691 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] validate_networks() for [('61ebd6c3-bd7b-408e-b6a6-97ced763519b', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:13:23.760416 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-eb041a04-5502-421e-8b3f-53fa80c6e15d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:23.776155 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-eb041a04-5502-421e-8b3f-53fa80c6e15d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.296974 Jun 23 17:13:23.778234 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 105/212] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:23 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:24.114899 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:13:24.115685 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:13:24.116290 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:13:24.116845 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:13:24.120878 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:13:24.129917 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:24.130370 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:24.131169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:24.131759 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:24.150775 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Getting quotas for project aa636b31dd844b93b83300a3de1418ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:13:24.156253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Getting quotas for user 89d1af25b199404b9f432b21c825b447 and project aa636b31dd844b93b83300a3de1418ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:13:24.168813 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:13:24.171725 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:13:24.230251 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fb7c4b1a-791d-43d0-8b7f-a9d63b55abe3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686727 Jun 23 17:13:24.231691 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 108/213] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:13:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 17:13:24.242596 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-0174444c-f0b1-4bb4-90af-f5523e7b7774 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:24.244075 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-0174444c-f0b1-4bb4-90af-f5523e7b7774 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:24.325566 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-0174444c-f0b1-4bb4-90af-f5523e7b7774 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:24.335289 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-0174444c-f0b1-4bb4-90af-f5523e7b7774 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1213 microversion: 2.1 time: 0.097365 Jun 23 17:13:24.337262 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 106/214] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:24 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:24.800949 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0c9ef482-0e83-4683-b1e3-8679a6c1b592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:24.801971 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0c9ef482-0e83-4683-b1e3-8679a6c1b592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:24.821570 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c9ef482-0e83-4683-b1e3-8679a6c1b592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:24.822338 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c9ef482-0e83-4683-b1e3-8679a6c1b592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:24.826393 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c9ef482-0e83-4683-b1e3-8679a6c1b592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:24.827950 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c9ef482-0e83-4683-b1e3-8679a6c1b592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:24.989083 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0c9ef482-0e83-4683-b1e3-8679a6c1b592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:24.998570 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0c9ef482-0e83-4683-b1e3-8679a6c1b592 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.204878 Jun 23 17:13:24.999256 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 109/215] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:24 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:13:25.353218 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-8df5b00b-8cdd-4c07-936d-3a112df7ea67 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:25.353932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-8df5b00b-8cdd-4c07-936d-3a112df7ea67 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:25.360331 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8df5b00b-8cdd-4c07-936d-3a112df7ea67 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:25.360834 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8df5b00b-8cdd-4c07-936d-3a112df7ea67 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:25.361727 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8df5b00b-8cdd-4c07-936d-3a112df7ea67 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:25.362504 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8df5b00b-8cdd-4c07-936d-3a112df7ea67 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:25.441753 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-8df5b00b-8cdd-4c07-936d-3a112df7ea67 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:25.449901 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-8df5b00b-8cdd-4c07-936d-3a112df7ea67 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1265 microversion: 2.1 time: 0.100883 Jun 23 17:13:25.450480 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 107/216] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:25 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:26.016331 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5ea034d8-9b2d-4373-a4fa-3e4401cea8eb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:26.017732 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5ea034d8-9b2d-4373-a4fa-3e4401cea8eb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:26.024792 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5ea034d8-9b2d-4373-a4fa-3e4401cea8eb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:26.025921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5ea034d8-9b2d-4373-a4fa-3e4401cea8eb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:26.026725 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5ea034d8-9b2d-4373-a4fa-3e4401cea8eb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:26.027295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5ea034d8-9b2d-4373-a4fa-3e4401cea8eb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:26.207055 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5ea034d8-9b2d-4373-a4fa-3e4401cea8eb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:26.215370 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5ea034d8-9b2d-4373-a4fa-3e4401cea8eb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.203211 Jun 23 17:13:26.215931 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 110/217] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:26 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:26.466896 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4d0c1496-38ae-4b3b-bb77-41e5a2b31420 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:26.468150 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4d0c1496-38ae-4b3b-bb77-41e5a2b31420 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:26.474493 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4d0c1496-38ae-4b3b-bb77-41e5a2b31420 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:26.475196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4d0c1496-38ae-4b3b-bb77-41e5a2b31420 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:26.476090 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4d0c1496-38ae-4b3b-bb77-41e5a2b31420 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:26.476679 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4d0c1496-38ae-4b3b-bb77-41e5a2b31420 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:26.562300 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4d0c1496-38ae-4b3b-bb77-41e5a2b31420 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:26.574780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4d0c1496-38ae-4b3b-bb77-41e5a2b31420 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1273 microversion: 2.1 time: 0.111366 Jun 23 17:13:26.576294 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 108/218] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:26 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:27.232501 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a3af8610-9523-412f-be30-f554d8828e8f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:27.233167 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a3af8610-9523-412f-be30-f554d8828e8f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:27.239769 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a3af8610-9523-412f-be30-f554d8828e8f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:27.240451 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a3af8610-9523-412f-be30-f554d8828e8f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:27.241388 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a3af8610-9523-412f-be30-f554d8828e8f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:27.241853 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a3af8610-9523-412f-be30-f554d8828e8f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:27.443683 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a3af8610-9523-412f-be30-f554d8828e8f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:27.458084 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a3af8610-9523-412f-be30-f554d8828e8f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.228386 Jun 23 17:13:27.459157 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 111/219] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:27 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:27.591676 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6b24ee36-8ef8-4a84-a1dc-2eed76c56fb1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:27.592504 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6b24ee36-8ef8-4a84-a1dc-2eed76c56fb1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:27.603077 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6b24ee36-8ef8-4a84-a1dc-2eed76c56fb1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:27.603645 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6b24ee36-8ef8-4a84-a1dc-2eed76c56fb1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:27.604492 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6b24ee36-8ef8-4a84-a1dc-2eed76c56fb1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:27.605123 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6b24ee36-8ef8-4a84-a1dc-2eed76c56fb1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:27.685390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6b24ee36-8ef8-4a84-a1dc-2eed76c56fb1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:27.695742 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6b24ee36-8ef8-4a84-a1dc-2eed76c56fb1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1283 microversion: 2.1 time: 0.108064 Jun 23 17:13:27.696431 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 109/220] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:27 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1283 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:28.475618 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-31438f77-63b6-4a61-b55d-415ddcb15f40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:28.476265 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-31438f77-63b6-4a61-b55d-415ddcb15f40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:28.483175 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-31438f77-63b6-4a61-b55d-415ddcb15f40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:28.483981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-31438f77-63b6-4a61-b55d-415ddcb15f40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:28.484985 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-31438f77-63b6-4a61-b55d-415ddcb15f40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:28.485642 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-31438f77-63b6-4a61-b55d-415ddcb15f40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:28.715049 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b6eb19f6-6fe1-48c0-94e2-a050cebcff11 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:28.715663 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b6eb19f6-6fe1-48c0-94e2-a050cebcff11 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:28.723902 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b6eb19f6-6fe1-48c0-94e2-a050cebcff11 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:28.724562 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b6eb19f6-6fe1-48c0-94e2-a050cebcff11 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:28.725330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b6eb19f6-6fe1-48c0-94e2-a050cebcff11 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:28.725756 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b6eb19f6-6fe1-48c0-94e2-a050cebcff11 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:28.754399 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-31438f77-63b6-4a61-b55d-415ddcb15f40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:28.764064 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-31438f77-63b6-4a61-b55d-415ddcb15f40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.292434 Jun 23 17:13:28.776848 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 112/221] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:28 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:28.920525 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b6eb19f6-6fe1-48c0-94e2-a050cebcff11 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:28.923951 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:28.934239 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b6eb19f6-6fe1-48c0-94e2-a050cebcff11 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1313 microversion: 2.1 time: 0.221082 Jun 23 17:13:28.935121 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 110/222] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:28 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:13:29.212133 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ae68850e-2ba2-4319-917c-3c8da3d3b7ac tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:29.212625 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ae68850e-2ba2-4319-917c-3c8da3d3b7ac tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:29.219822 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae68850e-2ba2-4319-917c-3c8da3d3b7ac tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:29.220530 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae68850e-2ba2-4319-917c-3c8da3d3b7ac tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:29.221330 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae68850e-2ba2-4319-917c-3c8da3d3b7ac tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:29.221764 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae68850e-2ba2-4319-917c-3c8da3d3b7ac tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:29.285366 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ae68850e-2ba2-4319-917c-3c8da3d3b7ac tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:13:29.405124 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ae68850e-2ba2-4319-917c-3c8da3d3b7ac tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 204 len: 0 microversion: 2.1 time: 0.198148 Jun 23 17:13:29.406003 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 113/223] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:13:29 2022] DELETE /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:13:29.418163 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-da299fd8-0cd3-49ce-8c95-ff3053698eae tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:29.419102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-da299fd8-0cd3-49ce-8c95-ff3053698eae tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:29.427196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-da299fd8-0cd3-49ce-8c95-ff3053698eae tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:29.427788 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-da299fd8-0cd3-49ce-8c95-ff3053698eae tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:29.428607 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-da299fd8-0cd3-49ce-8c95-ff3053698eae tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:29.429188 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-da299fd8-0cd3-49ce-8c95-ff3053698eae tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:29.589633 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-da299fd8-0cd3-49ce-8c95-ff3053698eae tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:29.604190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-da299fd8-0cd3-49ce-8c95-ff3053698eae tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1552 microversion: 2.1 time: 0.192325 Jun 23 17:13:29.604790 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 111/224] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:29 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1552 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:13:29.786001 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5d62f6d0-acb0-4a05-abf2-65faacec2965 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:29.786751 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5d62f6d0-acb0-4a05-abf2-65faacec2965 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:29.794710 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d62f6d0-acb0-4a05-abf2-65faacec2965 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:29.795100 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d62f6d0-acb0-4a05-abf2-65faacec2965 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:29.795918 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d62f6d0-acb0-4a05-abf2-65faacec2965 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:29.796434 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d62f6d0-acb0-4a05-abf2-65faacec2965 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:29.804345 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-f098152e-77c9-44c0-a5e0-cac3fea5bb49 req-aafe8123-7664-448b-b380-5c8b5c6cdf1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55f7f013-449c-4054-b481-780884c79d4a", "tag": "d160f76f-5be5-4ce6-be7e-4a20b3b492c9"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:13:29.819604 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-f098152e-77c9-44c0-a5e0-cac3fea5bb49 req-aafe8123-7664-448b-b380-5c8b5c6cdf1e service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:29.820042 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-f098152e-77c9-44c0-a5e0-cac3fea5bb49 req-aafe8123-7664-448b-b380-5c8b5c6cdf1e service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:29.838218 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-f098152e-77c9-44c0-a5e0-cac3fea5bb49 req-aafe8123-7664-448b-b380-5c8b5c6cdf1e service nova] Creating event network-changed:d160f76f-5be5-4ce6-be7e-4a20b3b492c9 for instance 55f7f013-449c-4054-b481-780884c79d4a on hv-cinder-83538 Jun 23 17:13:29.857514 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-f098152e-77c9-44c0-a5e0-cac3fea5bb49 req-aafe8123-7664-448b-b380-5c8b5c6cdf1e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056925 Jun 23 17:13:29.858611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 112/225] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:13:29.954733 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b126410e-c9b9-41c3-b014-f4162dcef2f0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:29.955957 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b126410e-c9b9-41c3-b014-f4162dcef2f0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:29.970732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b126410e-c9b9-41c3-b014-f4162dcef2f0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:29.973001 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b126410e-c9b9-41c3-b014-f4162dcef2f0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:29.974776 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b126410e-c9b9-41c3-b014-f4162dcef2f0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:29.975397 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b126410e-c9b9-41c3-b014-f4162dcef2f0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:29.987661 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5d62f6d0-acb0-4a05-abf2-65faacec2965 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:29.997867 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5d62f6d0-acb0-4a05-abf2-65faacec2965 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.218446 Jun 23 17:13:29.998838 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 114/226] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:29 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:30.127482 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b126410e-c9b9-41c3-b014-f4162dcef2f0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:30.135418 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b126410e-c9b9-41c3-b014-f4162dcef2f0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1313 microversion: 2.1 time: 0.186142 Jun 23 17:13:30.136202 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 113/227] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:29 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:30.627038 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0eb8bb46-da62-4297-9136-9d89fb1156b9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:30.628106 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0eb8bb46-da62-4297-9136-9d89fb1156b9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:30.636511 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0eb8bb46-da62-4297-9136-9d89fb1156b9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:30.637102 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0eb8bb46-da62-4297-9136-9d89fb1156b9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:30.638159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0eb8bb46-da62-4297-9136-9d89fb1156b9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:30.638727 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0eb8bb46-da62-4297-9136-9d89fb1156b9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:30.787481 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0eb8bb46-da62-4297-9136-9d89fb1156b9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:30.795909 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0eb8bb46-da62-4297-9136-9d89fb1156b9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1552 microversion: 2.1 time: 0.174178 Jun 23 17:13:30.796491 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 115/228] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:30 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:31.015754 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e947a3a1-8fd9-4428-8044-8dc1be441b33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:31.016362 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e947a3a1-8fd9-4428-8044-8dc1be441b33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:31.022809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e947a3a1-8fd9-4428-8044-8dc1be441b33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:31.023252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e947a3a1-8fd9-4428-8044-8dc1be441b33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:31.024046 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e947a3a1-8fd9-4428-8044-8dc1be441b33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:31.024584 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e947a3a1-8fd9-4428-8044-8dc1be441b33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:31.152649 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-56a366ae-51c7-455e-88fa-815ea24f48cd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:31.153251 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-56a366ae-51c7-455e-88fa-815ea24f48cd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:31.158936 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e947a3a1-8fd9-4428-8044-8dc1be441b33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:31.159766 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-56a366ae-51c7-455e-88fa-815ea24f48cd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:31.160225 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-56a366ae-51c7-455e-88fa-815ea24f48cd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:31.161219 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-56a366ae-51c7-455e-88fa-815ea24f48cd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:31.161653 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-56a366ae-51c7-455e-88fa-815ea24f48cd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:31.167191 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e947a3a1-8fd9-4428-8044-8dc1be441b33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.155213 Jun 23 17:13:31.167791 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 114/229] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:31 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:31.295097 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-56a366ae-51c7-455e-88fa-815ea24f48cd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:31.303149 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-56a366ae-51c7-455e-88fa-815ea24f48cd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1313 microversion: 2.1 time: 0.154472 Jun 23 17:13:31.303745 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 116/230] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:31 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:31.814873 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-8b3854d5-9470-4032-b0a1-8d1f77691cfd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:31.815496 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-8b3854d5-9470-4032-b0a1-8d1f77691cfd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:31.827215 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8b3854d5-9470-4032-b0a1-8d1f77691cfd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:31.827682 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8b3854d5-9470-4032-b0a1-8d1f77691cfd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:31.828434 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8b3854d5-9470-4032-b0a1-8d1f77691cfd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:31.829486 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8b3854d5-9470-4032-b0a1-8d1f77691cfd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:31.975891 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-8b3854d5-9470-4032-b0a1-8d1f77691cfd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:31.984146 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-8b3854d5-9470-4032-b0a1-8d1f77691cfd tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1552 microversion: 2.1 time: 0.174284 Jun 23 17:13:31.984700 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 115/231] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:31 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:32.184810 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-52d45abb-1d92-4440-bb98-aa560ccca1d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:32.186198 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-52d45abb-1d92-4440-bb98-aa560ccca1d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:32.196202 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-52d45abb-1d92-4440-bb98-aa560ccca1d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:32.196704 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-52d45abb-1d92-4440-bb98-aa560ccca1d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:32.197632 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-52d45abb-1d92-4440-bb98-aa560ccca1d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:32.198108 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-52d45abb-1d92-4440-bb98-aa560ccca1d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:32.320015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d37b9087-bffa-45a2-b4cc-66172ce9bdd0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:32.320694 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d37b9087-bffa-45a2-b4cc-66172ce9bdd0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:32.331392 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d37b9087-bffa-45a2-b4cc-66172ce9bdd0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:32.332594 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d37b9087-bffa-45a2-b4cc-66172ce9bdd0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:32.332718 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d37b9087-bffa-45a2-b4cc-66172ce9bdd0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:32.333133 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d37b9087-bffa-45a2-b4cc-66172ce9bdd0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:32.475800 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-52d45abb-1d92-4440-bb98-aa560ccca1d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:32.485177 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-52d45abb-1d92-4440-bb98-aa560ccca1d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.304403 Jun 23 17:13:32.502316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 117/232] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:32 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:32.552165 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d37b9087-bffa-45a2-b4cc-66172ce9bdd0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:32.559762 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d37b9087-bffa-45a2-b4cc-66172ce9bdd0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1313 microversion: 2.1 time: 0.244042 Jun 23 17:13:32.569973 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 116/233] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:32 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:33.001090 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2ccd3fe3-41c3-42ee-bc57-79c869d195ec tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:33.002318 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2ccd3fe3-41c3-42ee-bc57-79c869d195ec tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:33.009685 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ccd3fe3-41c3-42ee-bc57-79c869d195ec tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:33.010454 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ccd3fe3-41c3-42ee-bc57-79c869d195ec tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:33.011474 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ccd3fe3-41c3-42ee-bc57-79c869d195ec tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:33.012121 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ccd3fe3-41c3-42ee-bc57-79c869d195ec tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:33.507779 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b1e7e0a0-2522-4805-bca9-ce666a3f44bf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:33.508397 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b1e7e0a0-2522-4805-bca9-ce666a3f44bf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:33.522982 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b1e7e0a0-2522-4805-bca9-ce666a3f44bf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:33.532395 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b1e7e0a0-2522-4805-bca9-ce666a3f44bf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:33.533391 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b1e7e0a0-2522-4805-bca9-ce666a3f44bf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:33.534229 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b1e7e0a0-2522-4805-bca9-ce666a3f44bf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:33.576782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2ccd3fe3-41c3-42ee-bc57-79c869d195ec tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:33.590689 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2ccd3fe3-41c3-42ee-bc57-79c869d195ec tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1552 microversion: 2.1 time: 0.592817 Jun 23 17:13:33.594631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 118/234] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:32 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1552 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:33.610585 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-76df9b50-65ce-4ffa-bd07-5c18c23882bd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:33.611699 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-76df9b50-65ce-4ffa-bd07-5c18c23882bd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:33.623468 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76df9b50-65ce-4ffa-bd07-5c18c23882bd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:33.623941 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76df9b50-65ce-4ffa-bd07-5c18c23882bd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:33.624728 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76df9b50-65ce-4ffa-bd07-5c18c23882bd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:33.625151 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76df9b50-65ce-4ffa-bd07-5c18c23882bd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:33.732101 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b1e7e0a0-2522-4805-bca9-ce666a3f44bf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:33.740211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b1e7e0a0-2522-4805-bca9-ce666a3f44bf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.236989 Jun 23 17:13:33.740786 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 117/235] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:33 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:33.745133 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-bd71d97a-0b22-4634-b46d-274a7d21fb8f req-db63f469-7620-45c6-a9ff-f5ddf8c05f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b077dba-5836-45fb-a0e5-3a19c5a5c124", "name": "network-vif-deleted", "tag": "8910ed54-da53-4e0c-a689-825852d3a4cf"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:13:33.753563 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-bd71d97a-0b22-4634-b46d-274a7d21fb8f req-db63f469-7620-45c6-a9ff-f5ddf8c05f33 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:33.754033 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-bd71d97a-0b22-4634-b46d-274a7d21fb8f req-db63f469-7620-45c6-a9ff-f5ddf8c05f33 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:33.765065 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-bd71d97a-0b22-4634-b46d-274a7d21fb8f req-db63f469-7620-45c6-a9ff-f5ddf8c05f33 service nova] Creating event network-vif-deleted:8910ed54-da53-4e0c-a689-825852d3a4cf for instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 on hv-cinder-83538 Jun 23 17:13:33.770358 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-bd71d97a-0b22-4634-b46d-274a7d21fb8f req-db63f469-7620-45c6-a9ff-f5ddf8c05f33 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028384 Jun 23 17:13:33.770957 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 118/236] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:13:33.797553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-76df9b50-65ce-4ffa-bd07-5c18c23882bd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:33.805403 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-76df9b50-65ce-4ffa-bd07-5c18c23882bd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1313 microversion: 2.1 time: 0.209747 Jun 23 17:13:33.806004 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 119/237] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:33 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:34.612348 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c1978dc2-5c37-4651-b347-882dae2637f9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:34.613025 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c1978dc2-5c37-4651-b347-882dae2637f9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:34.615072 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=2 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:34.615921 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=74 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:34.622983 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c1978dc2-5c37-4651-b347-882dae2637f9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:34.623432 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c1978dc2-5c37-4651-b347-882dae2637f9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:34.624198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c1978dc2-5c37-4651-b347-882dae2637f9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:34.624626 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c1978dc2-5c37-4651-b347-882dae2637f9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:34.694742 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c1978dc2-5c37-4651-b347-882dae2637f9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:34.703435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c1978dc2-5c37-4651-b347-882dae2637f9 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1510 microversion: 2.1 time: 0.096392 Jun 23 17:13:34.704119 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 119/238] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:34 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1510 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:34.756604 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-56c29f80-038d-4abb-8dcb-ebcddc02ecdf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:34.757267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-56c29f80-038d-4abb-8dcb-ebcddc02ecdf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:34.759623 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:34.761110 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:34.769379 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-56c29f80-038d-4abb-8dcb-ebcddc02ecdf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:34.771481 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-56c29f80-038d-4abb-8dcb-ebcddc02ecdf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:34.772760 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-56c29f80-038d-4abb-8dcb-ebcddc02ecdf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:34.773558 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-56c29f80-038d-4abb-8dcb-ebcddc02ecdf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:34.824358 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-85ecf89e-39a4-4911-a7e0-c9e88c1598ea tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:34.825018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-85ecf89e-39a4-4911-a7e0-c9e88c1598ea tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:34.838969 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-85ecf89e-39a4-4911-a7e0-c9e88c1598ea tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:34.839696 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-85ecf89e-39a4-4911-a7e0-c9e88c1598ea tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:34.840937 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-85ecf89e-39a4-4911-a7e0-c9e88c1598ea tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:34.841554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-85ecf89e-39a4-4911-a7e0-c9e88c1598ea tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:35.012285 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-56c29f80-038d-4abb-8dcb-ebcddc02ecdf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:35.020727 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-56c29f80-038d-4abb-8dcb-ebcddc02ecdf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.268194 Jun 23 17:13:35.032200 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 120/239] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:34 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:35.060195 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-85ecf89e-39a4-4911-a7e0-c9e88c1598ea tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:35.071802 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-85ecf89e-39a4-4911-a7e0-c9e88c1598ea tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1313 microversion: 2.1 time: 0.252961 Jun 23 17:13:35.073013 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 120/240] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:34 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:35.721004 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7dae7969-cc54-465f-a55e-864da956924e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:35.721605 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7dae7969-cc54-465f-a55e-864da956924e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:35.723545 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:35.729214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7dae7969-cc54-465f-a55e-864da956924e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:35.729766 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7dae7969-cc54-465f-a55e-864da956924e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:35.730559 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7dae7969-cc54-465f-a55e-864da956924e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:35.730972 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7dae7969-cc54-465f-a55e-864da956924e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:35.812169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7dae7969-cc54-465f-a55e-864da956924e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:35.821780 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7dae7969-cc54-465f-a55e-864da956924e tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1510 microversion: 2.1 time: 0.104717 Jun 23 17:13:35.822385 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 121/241] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:35 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1510 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:36.038165 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-17b3d9f6-727e-4354-97c2-e5c729bb9668 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:36.039017 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-17b3d9f6-727e-4354-97c2-e5c729bb9668 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:36.045627 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-17b3d9f6-727e-4354-97c2-e5c729bb9668 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:36.046168 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-17b3d9f6-727e-4354-97c2-e5c729bb9668 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:36.046949 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-17b3d9f6-727e-4354-97c2-e5c729bb9668 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:36.047378 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-17b3d9f6-727e-4354-97c2-e5c729bb9668 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:36.089426 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f8d1118c-4bea-4f2e-83d2-8e3f36bc5583 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:36.090291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f8d1118c-4bea-4f2e-83d2-8e3f36bc5583 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:36.097043 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8d1118c-4bea-4f2e-83d2-8e3f36bc5583 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:36.097737 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8d1118c-4bea-4f2e-83d2-8e3f36bc5583 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:36.099238 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8d1118c-4bea-4f2e-83d2-8e3f36bc5583 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:36.099762 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8d1118c-4bea-4f2e-83d2-8e3f36bc5583 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:36.193237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-17b3d9f6-727e-4354-97c2-e5c729bb9668 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:36.201395 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-17b3d9f6-727e-4354-97c2-e5c729bb9668 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.167497 Jun 23 17:13:36.211441 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 121/242] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:36 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:36.263556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f8d1118c-4bea-4f2e-83d2-8e3f36bc5583 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:36.271845 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f8d1118c-4bea-4f2e-83d2-8e3f36bc5583 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1313 microversion: 2.1 time: 0.186942 Jun 23 17:13:36.272454 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 122/243] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:36 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:36.840234 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c964bc30-f413-41c9-b406-df15d25a4171 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:36.840839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c964bc30-f413-41c9-b406-df15d25a4171 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:36.849533 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c964bc30-f413-41c9-b406-df15d25a4171 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:36.850369 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c964bc30-f413-41c9-b406-df15d25a4171 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:36.859807 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c964bc30-f413-41c9-b406-df15d25a4171 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:36.860795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c964bc30-f413-41c9-b406-df15d25a4171 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:36.944821 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c964bc30-f413-41c9-b406-df15d25a4171 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:36.953705 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c964bc30-f413-41c9-b406-df15d25a4171 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1510 microversion: 2.1 time: 0.118471 Jun 23 17:13:36.954448 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 122/244] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:36 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1510 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:37.218941 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8fd631cd-78b1-4c58-85dd-4dc70be93284 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:37.219533 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8fd631cd-78b1-4c58-85dd-4dc70be93284 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:37.227742 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8fd631cd-78b1-4c58-85dd-4dc70be93284 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:37.228569 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8fd631cd-78b1-4c58-85dd-4dc70be93284 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:37.229596 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8fd631cd-78b1-4c58-85dd-4dc70be93284 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:37.230322 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8fd631cd-78b1-4c58-85dd-4dc70be93284 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:37.272694 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:37.288959 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d4659932-26b6-44e6-a0c7-0ee1ca137f78 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:37.289698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d4659932-26b6-44e6-a0c7-0ee1ca137f78 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:37.300428 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d4659932-26b6-44e6-a0c7-0ee1ca137f78 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:37.300939 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d4659932-26b6-44e6-a0c7-0ee1ca137f78 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:37.303180 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d4659932-26b6-44e6-a0c7-0ee1ca137f78 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:37.305412 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d4659932-26b6-44e6-a0c7-0ee1ca137f78 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:37.479914 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8fd631cd-78b1-4c58-85dd-4dc70be93284 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:37.488945 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8fd631cd-78b1-4c58-85dd-4dc70be93284 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.273547 Jun 23 17:13:37.490989 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 123/245] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:37 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:37.553110 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d4659932-26b6-44e6-a0c7-0ee1ca137f78 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:37.563180 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d4659932-26b6-44e6-a0c7-0ee1ca137f78 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1313 microversion: 2.1 time: 0.278192 Jun 23 17:13:37.564156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 123/246] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:37 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:13:37.971849 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2b1394a4-8305-42fb-aa34-7a2199b73dd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:37.972977 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2b1394a4-8305-42fb-aa34-7a2199b73dd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:37.979486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2b1394a4-8305-42fb-aa34-7a2199b73dd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:37.979855 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2b1394a4-8305-42fb-aa34-7a2199b73dd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:37.980664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2b1394a4-8305-42fb-aa34-7a2199b73dd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:37.981217 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2b1394a4-8305-42fb-aa34-7a2199b73dd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:38.013200 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2b1394a4-8305-42fb-aa34-7a2199b73dd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:38.013638 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2b1394a4-8305-42fb-aa34-7a2199b73dd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:38.014099 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-2b1394a4-8305-42fb-aa34-7a2199b73dd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lazy-loading 'fault' on Instance uuid 9b077dba-5836-45fb-a0e5-3a19c5a5c124 {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:13:38.058686 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2b1394a4-8305-42fb-aa34-7a2199b73dd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc70e58a764f7e9e065aead58c425a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8355cfdfed4f44f689922335c2845c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:38.069557 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2b1394a4-8305-42fb-aa34-7a2199b73dd7 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 200 len: 1350 microversion: 2.1 time: 0.101774 Jun 23 17:13:38.070221 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 124/247] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:37 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:38.508851 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-91e3c672-b473-441e-8162-8c5febfe25e9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:38.510574 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-91e3c672-b473-441e-8162-8c5febfe25e9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:38.517203 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-91e3c672-b473-441e-8162-8c5febfe25e9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:38.518612 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-91e3c672-b473-441e-8162-8c5febfe25e9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:38.519690 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-91e3c672-b473-441e-8162-8c5febfe25e9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:38.520609 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-91e3c672-b473-441e-8162-8c5febfe25e9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:38.580960 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-aa269fe0-1242-4ce3-95f6-e7b99094133c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:38.581677 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-aa269fe0-1242-4ce3-95f6-e7b99094133c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:38.589242 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aa269fe0-1242-4ce3-95f6-e7b99094133c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:38.589685 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aa269fe0-1242-4ce3-95f6-e7b99094133c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:38.590481 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aa269fe0-1242-4ce3-95f6-e7b99094133c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:38.590910 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aa269fe0-1242-4ce3-95f6-e7b99094133c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:38.744489 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-aa269fe0-1242-4ce3-95f6-e7b99094133c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:38.753063 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-aa269fe0-1242-4ce3-95f6-e7b99094133c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1313 microversion: 2.1 time: 0.176128 Jun 23 17:13:38.753642 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 125/248] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:38 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:13:38.753956 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-91e3c672-b473-441e-8162-8c5febfe25e9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:38.761980 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-91e3c672-b473-441e-8162-8c5febfe25e9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.257629 Jun 23 17:13:38.763600 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 124/249] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:38 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:39.089880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fae6cfa6-8718-4071-8617-22cd374cd963 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:39.091962 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fae6cfa6-8718-4071-8617-22cd374cd963 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:39.103842 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fae6cfa6-8718-4071-8617-22cd374cd963 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:39.105240 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fae6cfa6-8718-4071-8617-22cd374cd963 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:39.106638 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fae6cfa6-8718-4071-8617-22cd374cd963 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:39.108398 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fae6cfa6-8718-4071-8617-22cd374cd963 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:39.127346 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-fae6cfa6-8718-4071-8617-22cd374cd963 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] HTTP exception thrown: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fae6cfa6-8718-4071-8617-22cd374cd963 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Request method failure captured: Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 HTTP/1.1 Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ7lYXwHPT73NKBYYieNLZkaUNSUuSkdyu-gOK-ZkL8cMegI88oQR1C-j87rpciR-RFygnAuz8HzRw8szOFA5R1FUcyM5Wv5mIZB3y4xjRw-LvvqfJgZ8NlD_xK_eJ_aRK7pIMu1hSNk6jr4jSEUR3AGl4EQ90iDVxJuQHehrbhCSg0 Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: 8355cfdfed4f44f689922335c2845c50 Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-DeleteServersTestJSON-503735289 Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:13:39.135291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:13:39.136880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8355cfdfed4f44f689922335c2845c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8355cfdfed4f44f689922335c2845c50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8355cfdfed4f44f689922335c2845c50", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8355cfdfed4f44f689922335c2845c50"}]}] Jun 23 17:13:39.136880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-DeleteServersTestJSON-503735289 Jun 23 17:13:39.136880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 8355cfdfed4f44f689922335c2845c50 Jun 23 17:13:39.136880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-DeleteServersTestJSON-503735289 Jun 23 17:13:39.136880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-DeleteServersTestJSON-503735289-project Jun 23 17:13:39.136880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:13:39.136880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:13:39.136880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: 41bc70e58a764f7e9e065aead58c425a Jun 23 17:13:39.136880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-DeleteServersTestJSON-503735289-project Jun 23 17:13:39.136880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:13:39.136880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:39.136880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '9b077dba-5836-45fb-a0e5-3a19c5a5c124'} Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:13:39.137754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:39.139172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:39.140374 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fae6cfa6-8718-4071-8617-22cd374cd963 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Returning 404 to user: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:13:39.140961 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fae6cfa6-8718-4071-8617-22cd374cd963 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 404 len: 111 microversion: 2.1 time: 0.057384 Jun 23 17:13:39.141606 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 126/250] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:39 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:13:39.240958 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-af9e3e44-b3e5-4043-b5b7-aa53d95f2542 req-6fa2599a-57b1-4016-b484-646dcb5ccdb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55f7f013-449c-4054-b481-780884c79d4a", "name": "network-vif-plugged", "status": "completed", "tag": "d160f76f-5be5-4ce6-be7e-4a20b3b492c9"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:13:39.265015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-af9e3e44-b3e5-4043-b5b7-aa53d95f2542 req-6fa2599a-57b1-4016-b484-646dcb5ccdb7 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:39.265015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-af9e3e44-b3e5-4043-b5b7-aa53d95f2542 req-6fa2599a-57b1-4016-b484-646dcb5ccdb7 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:39.297039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-af9e3e44-b3e5-4043-b5b7-aa53d95f2542 req-6fa2599a-57b1-4016-b484-646dcb5ccdb7 service nova] Creating event network-vif-plugged:d160f76f-5be5-4ce6-be7e-4a20b3b492c9 for instance 55f7f013-449c-4054-b481-780884c79d4a on hv-cinder-83538 Jun 23 17:13:39.310267 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-af9e3e44-b3e5-4043-b5b7-aa53d95f2542 req-6fa2599a-57b1-4016-b484-646dcb5ccdb7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076659 Jun 23 17:13:39.310936 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 125/251] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:13:39.344256 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a8501722-ad8e-44ad-b5f3-d4cf50fb04f8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:39.345293 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a8501722-ad8e-44ad-b5f3-d4cf50fb04f8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:39.357326 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8501722-ad8e-44ad-b5f3-d4cf50fb04f8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:39.357759 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8501722-ad8e-44ad-b5f3-d4cf50fb04f8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:39.358623 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8501722-ad8e-44ad-b5f3-d4cf50fb04f8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:39.360191 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8501722-ad8e-44ad-b5f3-d4cf50fb04f8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:39.383779 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-a8501722-ad8e-44ad-b5f3-d4cf50fb04f8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] HTTP exception thrown: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a8501722-ad8e-44ad-b5f3-d4cf50fb04f8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Request method failure captured: Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124/os-volume_attachments HTTP/1.1 Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ7lYXwHPT73NKBYYieNLZkaUNSUuSkdyu-gOK-ZkL8cMegI88oQR1C-j87rpciR-RFygnAuz8HzRw8szOFA5R1FUcyM5Wv5mIZB3y4xjRw-LvvqfJgZ8NlD_xK_eJ_aRK7pIMu1hSNk6jr4jSEUR3AGl4EQ90iDVxJuQHehrbhCSg0 Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: 8355cfdfed4f44f689922335c2845c50 Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-DeleteServersTestJSON-503735289 Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:13:39.385314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:13:39.386551 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8355cfdfed4f44f689922335c2845c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8355cfdfed4f44f689922335c2845c50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8355cfdfed4f44f689922335c2845c50", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8355cfdfed4f44f689922335c2845c50"}]}] Jun 23 17:13:39.386551 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-DeleteServersTestJSON-503735289 Jun 23 17:13:39.386551 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 8355cfdfed4f44f689922335c2845c50 Jun 23 17:13:39.386551 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-DeleteServersTestJSON-503735289 Jun 23 17:13:39.386551 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-DeleteServersTestJSON-503735289-project Jun 23 17:13:39.386551 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:13:39.386551 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:13:39.386551 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: 41bc70e58a764f7e9e065aead58c425a Jun 23 17:13:39.386551 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-DeleteServersTestJSON-503735289-project Jun 23 17:13:39.386551 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:13:39.386551 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:39.386551 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'server_id': '9b077dba-5836-45fb-a0e5-3a19c5a5c124'} Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:13:39.387214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:39.388316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:39.389518 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a8501722-ad8e-44ad-b5f3-d4cf50fb04f8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Returning 404 to user: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:13:39.389518 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a8501722-ad8e-44ad-b5f3-d4cf50fb04f8 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046620 Jun 23 17:13:39.390900 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 127/252] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:13:39 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:13:39.771348 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9c02a2c0-6e11-4582-9b2d-55b30fdf4d02 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:39.772473 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9c02a2c0-6e11-4582-9b2d-55b30fdf4d02 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:39.780192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-696b63fe-4dda-40a2-93e6-eb2502bd992e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:39.780655 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9c02a2c0-6e11-4582-9b2d-55b30fdf4d02 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:39.780655 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9c02a2c0-6e11-4582-9b2d-55b30fdf4d02 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:39.780798 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-696b63fe-4dda-40a2-93e6-eb2502bd992e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:39.781470 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9c02a2c0-6e11-4582-9b2d-55b30fdf4d02 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:39.782097 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9c02a2c0-6e11-4582-9b2d-55b30fdf4d02 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:39.793236 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-696b63fe-4dda-40a2-93e6-eb2502bd992e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:39.793743 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-696b63fe-4dda-40a2-93e6-eb2502bd992e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:39.795425 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-696b63fe-4dda-40a2-93e6-eb2502bd992e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:39.795874 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-696b63fe-4dda-40a2-93e6-eb2502bd992e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:39.932545 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9c02a2c0-6e11-4582-9b2d-55b30fdf4d02 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:39.941102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9c02a2c0-6e11-4582-9b2d-55b30fdf4d02 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1313 microversion: 2.1 time: 0.174093 Jun 23 17:13:39.942738 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 126/253] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:39 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:39.981564 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-696b63fe-4dda-40a2-93e6-eb2502bd992e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:39.989698 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-696b63fe-4dda-40a2-93e6-eb2502bd992e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.213806 Jun 23 17:13:39.998956 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 128/254] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:39 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:40.654232 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-06e0b274-da8f-4bf4-a41d-8b361d6a7825 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:40.654870 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-06e0b274-da8f-4bf4-a41d-8b361d6a7825 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:40.662354 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-06e0b274-da8f-4bf4-a41d-8b361d6a7825 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:40.662798 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-06e0b274-da8f-4bf4-a41d-8b361d6a7825 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:40.663608 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-06e0b274-da8f-4bf4-a41d-8b361d6a7825 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:40.664219 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-06e0b274-da8f-4bf4-a41d-8b361d6a7825 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:40.681478 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-06e0b274-da8f-4bf4-a41d-8b361d6a7825 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] HTTP exception thrown: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-06e0b274-da8f-4bf4-a41d-8b361d6a7825 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Request method failure captured: Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: DELETE /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 HTTP/1.1 Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7lYXwHPT73NKBYYieNLZkaUNSUuSkdyu-gOK-ZkL8cMegI88oQR1C-j87rpciR-RFygnAuz8HzRw8szOFA5R1FUcyM5Wv5mIZB3y4xjRw-LvvqfJgZ8NlD_xK_eJ_aRK7pIMu1hSNk6jr4jSEUR3AGl4EQ90iDVxJuQHehrbhCSg0 Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 8355cfdfed4f44f689922335c2845c50 Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-DeleteServersTestJSON-503735289 Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:13:40.692809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:13:40.694192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8355cfdfed4f44f689922335c2845c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8355cfdfed4f44f689922335c2845c50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8355cfdfed4f44f689922335c2845c50", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8355cfdfed4f44f689922335c2845c50"}]}] Jun 23 17:13:40.694192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-DeleteServersTestJSON-503735289 Jun 23 17:13:40.694192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 8355cfdfed4f44f689922335c2845c50 Jun 23 17:13:40.694192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-DeleteServersTestJSON-503735289 Jun 23 17:13:40.694192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-DeleteServersTestJSON-503735289-project Jun 23 17:13:40.694192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:13:40.694192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:13:40.694192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 41bc70e58a764f7e9e065aead58c425a Jun 23 17:13:40.694192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-DeleteServersTestJSON-503735289-project Jun 23 17:13:40.694192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:13:40.694192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:40.694192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '9b077dba-5836-45fb-a0e5-3a19c5a5c124'} Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:13:40.694977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:40.696161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:13:40.698119 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-06e0b274-da8f-4bf4-a41d-8b361d6a7825 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Returning 404 to user: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:13:40.699217 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-06e0b274-da8f-4bf4-a41d-8b361d6a7825 tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 404 len: 111 microversion: 2.1 time: 0.049418 Jun 23 17:13:40.699794 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 127/255] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:13:40 2022] DELETE /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:13:40.708486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-64e58f2e-e774-4d07-b407-1ace2b0fc01c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:40.709175 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-64e58f2e-e774-4d07-b407-1ace2b0fc01c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] [instance: 9b077dba-5836-45fb-a0e5-3a19c5a5c124] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:40.720235 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-64e58f2e-e774-4d07-b407-1ace2b0fc01c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:40.720780 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-64e58f2e-e774-4d07-b407-1ace2b0fc01c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:40.721649 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-64e58f2e-e774-4d07-b407-1ace2b0fc01c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:40.722180 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-64e58f2e-e774-4d07-b407-1ace2b0fc01c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:40.737971 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-64e58f2e-e774-4d07-b407-1ace2b0fc01c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] HTTP exception thrown: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-64e58f2e-e774-4d07-b407-1ace2b0fc01c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Request method failure captured: Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 HTTP/1.1 Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ7lYXwHPT73NKBYYieNLZkaUNSUuSkdyu-gOK-ZkL8cMegI88oQR1C-j87rpciR-RFygnAuz8HzRw8szOFA5R1FUcyM5Wv5mIZB3y4xjRw-LvvqfJgZ8NlD_xK_eJ_aRK7pIMu1hSNk6jr4jSEUR3AGl4EQ90iDVxJuQHehrbhCSg0 Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: 8355cfdfed4f44f689922335c2845c50 Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-DeleteServersTestJSON-503735289 Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:13:40.740195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:13:40.741556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8355cfdfed4f44f689922335c2845c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8355cfdfed4f44f689922335c2845c50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8355cfdfed4f44f689922335c2845c50", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8355cfdfed4f44f689922335c2845c50"}]}] Jun 23 17:13:40.741556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-DeleteServersTestJSON-503735289 Jun 23 17:13:40.741556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 8355cfdfed4f44f689922335c2845c50 Jun 23 17:13:40.741556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-DeleteServersTestJSON-503735289 Jun 23 17:13:40.741556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-DeleteServersTestJSON-503735289-project Jun 23 17:13:40.741556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:13:40.741556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:13:40.741556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: 41bc70e58a764f7e9e065aead58c425a Jun 23 17:13:40.741556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-DeleteServersTestJSON-503735289-project Jun 23 17:13:40.741556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:13:40.741556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:40.741556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '9b077dba-5836-45fb-a0e5-3a19c5a5c124'} Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:13:40.742267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. Jun 23 17:13:40.743336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:13:40.744289 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-64e58f2e-e774-4d07-b407-1ace2b0fc01c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] Returning 404 to user: Instance 9b077dba-5836-45fb-a0e5-3a19c5a5c124 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:13:40.744289 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-64e58f2e-e774-4d07-b407-1ace2b0fc01c tempest-DeleteServersTestJSON-503735289 tempest-DeleteServersTestJSON-503735289-project] 10.222.0.18 "GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124" status: 404 len: 111 microversion: 2.1 time: 0.038421 Jun 23 17:13:40.744289 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 129/256] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:40 2022] GET /compute/v2.1/servers/9b077dba-5836-45fb-a0e5-3a19c5a5c124 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 17:13:40.960152 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9d9470f1-b65f-4306-8ac6-e83595ed0580 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:40.961318 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9d9470f1-b65f-4306-8ac6-e83595ed0580 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:40.967909 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9d9470f1-b65f-4306-8ac6-e83595ed0580 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:40.968604 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9d9470f1-b65f-4306-8ac6-e83595ed0580 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:40.970370 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9d9470f1-b65f-4306-8ac6-e83595ed0580 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:40.970890 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9d9470f1-b65f-4306-8ac6-e83595ed0580 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:41.009458 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d9193af6-af65-4686-99ee-d6b3e25b6bc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:41.010817 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d9193af6-af65-4686-99ee-d6b3e25b6bc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:41.020127 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d9193af6-af65-4686-99ee-d6b3e25b6bc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:41.020890 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d9193af6-af65-4686-99ee-d6b3e25b6bc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:41.022157 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d9193af6-af65-4686-99ee-d6b3e25b6bc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:41.022925 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d9193af6-af65-4686-99ee-d6b3e25b6bc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:41.134113 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9d9470f1-b65f-4306-8ac6-e83595ed0580 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:41.143259 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9d9470f1-b65f-4306-8ac6-e83595ed0580 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1313 microversion: 2.1 time: 0.188549 Jun 23 17:13:41.144087 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 128/257] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:40 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:41.398853 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d9193af6-af65-4686-99ee-d6b3e25b6bc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:41.406536 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d9193af6-af65-4686-99ee-d6b3e25b6bc7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.404221 Jun 23 17:13:41.407090 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 130/258] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:41 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:42.164127 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-001eb120-ca0e-4c0f-b82d-b5777d95f7a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:42.164830 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-001eb120-ca0e-4c0f-b82d-b5777d95f7a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:42.172029 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-001eb120-ca0e-4c0f-b82d-b5777d95f7a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:42.172537 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-001eb120-ca0e-4c0f-b82d-b5777d95f7a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:42.173371 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-001eb120-ca0e-4c0f-b82d-b5777d95f7a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:42.174486 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-001eb120-ca0e-4c0f-b82d-b5777d95f7a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:42.400885 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-001eb120-ca0e-4c0f-b82d-b5777d95f7a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:42.411951 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-001eb120-ca0e-4c0f-b82d-b5777d95f7a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1497 microversion: 2.1 time: 0.255319 Jun 23 17:13:42.412849 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 129/259] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:42 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1497 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:42.427823 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-76c1e44d-5e6b-4ea1-b947-bff536efbf19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:42.429544 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-76c1e44d-5e6b-4ea1-b947-bff536efbf19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:42.438752 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76c1e44d-5e6b-4ea1-b947-bff536efbf19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:42.439195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76c1e44d-5e6b-4ea1-b947-bff536efbf19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:42.440355 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76c1e44d-5e6b-4ea1-b947-bff536efbf19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:42.441274 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76c1e44d-5e6b-4ea1-b947-bff536efbf19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:42.993408 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-76c1e44d-5e6b-4ea1-b947-bff536efbf19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:43.002286 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-76c1e44d-5e6b-4ea1-b947-bff536efbf19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.581049 Jun 23 17:13:43.013597 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 131/260] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:42 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:43.703036 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-67cac213-6922-4bcf-8c2c-b4ad7d60d4ad tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:43.704189 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-67cac213-6922-4bcf-8c2c-b4ad7d60d4ad tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:43.713685 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-67cac213-6922-4bcf-8c2c-b4ad7d60d4ad tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:43.714170 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-67cac213-6922-4bcf-8c2c-b4ad7d60d4ad tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:43.714926 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-67cac213-6922-4bcf-8c2c-b4ad7d60d4ad tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:43.715464 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-67cac213-6922-4bcf-8c2c-b4ad7d60d4ad tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:43.719803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:43.761293 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-67cac213-6922-4bcf-8c2c-b4ad7d60d4ad tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Going to try to terminate instance {{(pid=117897) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:13:43.862525 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-67cac213-6922-4bcf-8c2c-b4ad7d60d4ad tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "DELETE /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 204 len: 0 microversion: 2.1 time: 0.164039 Jun 23 17:13:43.863191 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 130/261] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:13:43 2022] DELETE /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:13:43.871522 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bb34b9e3-36ed-4a24-9a44-df2f4e94a6a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:43.872090 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bb34b9e3-36ed-4a24-9a44-df2f4e94a6a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:43.879041 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bb34b9e3-36ed-4a24-9a44-df2f4e94a6a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:43.879482 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bb34b9e3-36ed-4a24-9a44-df2f4e94a6a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:43.880274 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bb34b9e3-36ed-4a24-9a44-df2f4e94a6a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:43.880697 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bb34b9e3-36ed-4a24-9a44-df2f4e94a6a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:44.020870 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-48766643-5c00-45a7-8746-fa590deffd2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:44.021871 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-48766643-5c00-45a7-8746-fa590deffd2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:44.028914 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-48766643-5c00-45a7-8746-fa590deffd2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:44.029471 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-48766643-5c00-45a7-8746-fa590deffd2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:44.030315 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-48766643-5c00-45a7-8746-fa590deffd2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:44.030979 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-48766643-5c00-45a7-8746-fa590deffd2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:44.058903 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bb34b9e3-36ed-4a24-9a44-df2f4e94a6a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:44.067510 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bb34b9e3-36ed-4a24-9a44-df2f4e94a6a0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1503 microversion: 2.1 time: 0.199794 Jun 23 17:13:44.068202 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 132/262] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:43 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:44.279622 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-48766643-5c00-45a7-8746-fa590deffd2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:44.289471 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-48766643-5c00-45a7-8746-fa590deffd2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.272891 Jun 23 17:13:44.290314 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 131/263] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:44 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:45.085079 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2a62b198-5725-44b2-8ab2-15cff05cd104 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:45.085691 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2a62b198-5725-44b2-8ab2-15cff05cd104 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:45.092653 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2a62b198-5725-44b2-8ab2-15cff05cd104 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:45.093102 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2a62b198-5725-44b2-8ab2-15cff05cd104 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:45.093921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2a62b198-5725-44b2-8ab2-15cff05cd104 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:45.094538 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2a62b198-5725-44b2-8ab2-15cff05cd104 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:45.238155 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2a62b198-5725-44b2-8ab2-15cff05cd104 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:45.245934 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2a62b198-5725-44b2-8ab2-15cff05cd104 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1503 microversion: 2.1 time: 0.165165 Jun 23 17:13:45.246506 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 133/264] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:45 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:45.307188 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1e56644c-2f9f-4ab0-a83a-66a352d3cd77 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:45.307783 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1e56644c-2f9f-4ab0-a83a-66a352d3cd77 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:45.314630 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1e56644c-2f9f-4ab0-a83a-66a352d3cd77 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:45.315084 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1e56644c-2f9f-4ab0-a83a-66a352d3cd77 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:45.315857 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1e56644c-2f9f-4ab0-a83a-66a352d3cd77 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:45.316343 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1e56644c-2f9f-4ab0-a83a-66a352d3cd77 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:45.479575 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1e56644c-2f9f-4ab0-a83a-66a352d3cd77 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:45.487265 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1e56644c-2f9f-4ab0-a83a-66a352d3cd77 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.183935 Jun 23 17:13:45.488005 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 132/265] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:45 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:46.263604 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d45cf19c-b516-4447-ba0a-0943bc12ae98 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:46.267147 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d45cf19c-b516-4447-ba0a-0943bc12ae98 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:46.271357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d45cf19c-b516-4447-ba0a-0943bc12ae98 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:46.271847 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d45cf19c-b516-4447-ba0a-0943bc12ae98 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:46.272791 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d45cf19c-b516-4447-ba0a-0943bc12ae98 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:46.273227 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d45cf19c-b516-4447-ba0a-0943bc12ae98 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:46.434084 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d45cf19c-b516-4447-ba0a-0943bc12ae98 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:46.444185 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d45cf19c-b516-4447-ba0a-0943bc12ae98 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1503 microversion: 2.1 time: 0.184115 Jun 23 17:13:46.444382 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 134/266] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:46 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:46.507100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ea9f4387-c69a-41cd-90b4-e397a0a4bea3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:46.507769 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ea9f4387-c69a-41cd-90b4-e397a0a4bea3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:46.520741 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ea9f4387-c69a-41cd-90b4-e397a0a4bea3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:46.521134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ea9f4387-c69a-41cd-90b4-e397a0a4bea3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:46.522032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ea9f4387-c69a-41cd-90b4-e397a0a4bea3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:46.522330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ea9f4387-c69a-41cd-90b4-e397a0a4bea3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:46.688636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ea9f4387-c69a-41cd-90b4-e397a0a4bea3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:46.702595 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ea9f4387-c69a-41cd-90b4-e397a0a4bea3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.200874 Jun 23 17:13:46.703189 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 133/267] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:46 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:47.462323 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4a9ea2d7-01ff-4d3e-9c52-505f6d0d9787 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:47.462919 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4a9ea2d7-01ff-4d3e-9c52-505f6d0d9787 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:47.469645 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4a9ea2d7-01ff-4d3e-9c52-505f6d0d9787 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:47.470125 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4a9ea2d7-01ff-4d3e-9c52-505f6d0d9787 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:47.470879 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4a9ea2d7-01ff-4d3e-9c52-505f6d0d9787 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:47.471310 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4a9ea2d7-01ff-4d3e-9c52-505f6d0d9787 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:47.607541 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4a9ea2d7-01ff-4d3e-9c52-505f6d0d9787 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:47.615896 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4a9ea2d7-01ff-4d3e-9c52-505f6d0d9787 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1503 microversion: 2.1 time: 0.157498 Jun 23 17:13:47.616460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 135/268] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:47 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:47.720433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-12f9ef80-1b2e-4817-a2c4-fe4ce4d0c333 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:47.721033 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-12f9ef80-1b2e-4817-a2c4-fe4ce4d0c333 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:47.728489 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12f9ef80-1b2e-4817-a2c4-fe4ce4d0c333 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:47.728936 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12f9ef80-1b2e-4817-a2c4-fe4ce4d0c333 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:47.729685 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12f9ef80-1b2e-4817-a2c4-fe4ce4d0c333 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:47.730156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12f9ef80-1b2e-4817-a2c4-fe4ce4d0c333 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:47.870641 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-12f9ef80-1b2e-4817-a2c4-fe4ce4d0c333 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:47.878833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-12f9ef80-1b2e-4817-a2c4-fe4ce4d0c333 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.162246 Jun 23 17:13:47.879461 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 134/269] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:47 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:48.633274 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-47fa76d6-2ceb-48d8-a5ba-e8ba2cae9514 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:48.633897 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-47fa76d6-2ceb-48d8-a5ba-e8ba2cae9514 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:48.640768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-47fa76d6-2ceb-48d8-a5ba-e8ba2cae9514 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:48.641212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-47fa76d6-2ceb-48d8-a5ba-e8ba2cae9514 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:48.641992 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-47fa76d6-2ceb-48d8-a5ba-e8ba2cae9514 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:48.642419 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-47fa76d6-2ceb-48d8-a5ba-e8ba2cae9514 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:48.777760 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-47fa76d6-2ceb-48d8-a5ba-e8ba2cae9514 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:48.786519 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-47fa76d6-2ceb-48d8-a5ba-e8ba2cae9514 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1503 microversion: 2.1 time: 0.157453 Jun 23 17:13:48.787094 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 136/270] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:48 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:48.899297 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-106a18d4-c5c9-4b2c-ad56-c03f48d5a8f6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:48.900345 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-106a18d4-c5c9-4b2c-ad56-c03f48d5a8f6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:48.910553 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-106a18d4-c5c9-4b2c-ad56-c03f48d5a8f6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:48.911402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-106a18d4-c5c9-4b2c-ad56-c03f48d5a8f6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:48.912149 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-106a18d4-c5c9-4b2c-ad56-c03f48d5a8f6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:48.912575 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-106a18d4-c5c9-4b2c-ad56-c03f48d5a8f6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:49.059505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-106a18d4-c5c9-4b2c-ad56-c03f48d5a8f6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:49.071458 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-106a18d4-c5c9-4b2c-ad56-c03f48d5a8f6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.178511 Jun 23 17:13:49.072252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 135/271] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:48 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:49.807708 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-38cef98f-18e3-446e-826a-079ea79ca42f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:49.808729 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-38cef98f-18e3-446e-826a-079ea79ca42f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:49.820369 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-38cef98f-18e3-446e-826a-079ea79ca42f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:49.821111 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-38cef98f-18e3-446e-826a-079ea79ca42f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:49.822412 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-38cef98f-18e3-446e-826a-079ea79ca42f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:49.823124 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-38cef98f-18e3-446e-826a-079ea79ca42f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:49.965355 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-38cef98f-18e3-446e-826a-079ea79ca42f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:49.977091 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-38cef98f-18e3-446e-826a-079ea79ca42f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1503 microversion: 2.1 time: 0.175984 Jun 23 17:13:49.978034 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 137/272] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:49 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:50.095503 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-47b66442-d15e-420e-a8ae-6bff660a52cb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:50.096332 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-47b66442-d15e-420e-a8ae-6bff660a52cb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:50.107277 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-47b66442-d15e-420e-a8ae-6bff660a52cb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:50.107999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-47b66442-d15e-420e-a8ae-6bff660a52cb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:50.117392 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-47b66442-d15e-420e-a8ae-6bff660a52cb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:50.117932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-47b66442-d15e-420e-a8ae-6bff660a52cb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:50.257283 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-47b66442-d15e-420e-a8ae-6bff660a52cb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:50.265170 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-47b66442-d15e-420e-a8ae-6bff660a52cb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.176798 Jun 23 17:13:50.265719 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 136/273] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:50 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:50.999042 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d2360e5b-db3c-4d4e-ac59-16e9199d5100 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:50.999616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d2360e5b-db3c-4d4e-ac59-16e9199d5100 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:51.006958 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2360e5b-db3c-4d4e-ac59-16e9199d5100 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:51.007583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2360e5b-db3c-4d4e-ac59-16e9199d5100 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:51.008167 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2360e5b-db3c-4d4e-ac59-16e9199d5100 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:51.008613 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2360e5b-db3c-4d4e-ac59-16e9199d5100 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:51.144356 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d2360e5b-db3c-4d4e-ac59-16e9199d5100 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:51.154246 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d2360e5b-db3c-4d4e-ac59-16e9199d5100 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1503 microversion: 2.1 time: 0.158855 Jun 23 17:13:51.155161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 138/274] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:50 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:51.286468 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4eb112ad-6fbe-4acc-88ba-c6ae0234ec6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:51.287656 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4eb112ad-6fbe-4acc-88ba-c6ae0234ec6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:51.297871 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4eb112ad-6fbe-4acc-88ba-c6ae0234ec6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:51.298598 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4eb112ad-6fbe-4acc-88ba-c6ae0234ec6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:51.299825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4eb112ad-6fbe-4acc-88ba-c6ae0234ec6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:51.300523 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4eb112ad-6fbe-4acc-88ba-c6ae0234ec6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:51.444177 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4eb112ad-6fbe-4acc-88ba-c6ae0234ec6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:51.452116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4eb112ad-6fbe-4acc-88ba-c6ae0234ec6e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.172448 Jun 23 17:13:51.452690 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 137/275] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:51 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:51.898780 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-457118182", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:13:51.952889 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] validate_networks() for None {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:13:52.176339 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d4c19735-bcf7-48bb-84d5-f8aaee16cd2b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:52.176899 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d4c19735-bcf7-48bb-84d5-f8aaee16cd2b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:52.183317 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d4c19735-bcf7-48bb-84d5-f8aaee16cd2b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:52.183756 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d4c19735-bcf7-48bb-84d5-f8aaee16cd2b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:52.184494 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d4c19735-bcf7-48bb-84d5-f8aaee16cd2b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:52.184918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d4c19735-bcf7-48bb-84d5-f8aaee16cd2b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:52.283515 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:13:52.284035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:13:52.284366 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:13:52.284947 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:13:52.285351 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:13:52.294683 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:52.295394 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:52.296195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:52.296628 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:52.314361 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Getting quotas for project 99c8d1e8f35e461dbdc25783106e4a44. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:13:52.318566 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Getting quotas for user 4d5064e0f807490ab7f83657ff51a09f and project 99c8d1e8f35e461dbdc25783106e4a44. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:13:52.323038 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d4c19735-bcf7-48bb-84d5-f8aaee16cd2b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:52.331037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:13:52.332214 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d4c19735-bcf7-48bb-84d5-f8aaee16cd2b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1503 microversion: 2.1 time: 0.159916 Jun 23 17:13:52.333087 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 138/276] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:52 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:52.341977 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:13:52.378111 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-593a4ad6-634b-4830-9914-da93718da3ca tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483216 Jun 23 17:13:52.378771 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 139/277] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:13:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:13:52.388785 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5ad2441c-cefe-48c4-9897-cc06ed548799 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:52.389382 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5ad2441c-cefe-48c4-9897-cc06ed548799 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:52.450208 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5ad2441c-cefe-48c4-9897-cc06ed548799 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:52.458518 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5ad2441c-cefe-48c4-9897-cc06ed548799 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1214 microversion: 2.1 time: 0.073713 Jun 23 17:13:52.459199 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 139/278] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:52 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:52.473218 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-34aaa19d-cf04-4de6-aaf3-fcce9f07751c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:52.473967 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-34aaa19d-cf04-4de6-aaf3-fcce9f07751c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:52.481351 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-34aaa19d-cf04-4de6-aaf3-fcce9f07751c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:52.482335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-34aaa19d-cf04-4de6-aaf3-fcce9f07751c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:52.483252 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-34aaa19d-cf04-4de6-aaf3-fcce9f07751c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:52.483839 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-34aaa19d-cf04-4de6-aaf3-fcce9f07751c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:52.726506 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-34aaa19d-cf04-4de6-aaf3-fcce9f07751c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:52.738346 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-34aaa19d-cf04-4de6-aaf3-fcce9f07751c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.268985 Jun 23 17:13:52.739143 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 140/279] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:52 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:52.768253 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-9868a825-b02d-416a-875a-afb5e90ee2c1 req-56c03fe2-44aa-47e5-8299-29ff3fc46d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55f7f013-449c-4054-b481-780884c79d4a", "name": "network-vif-deleted", "tag": "d160f76f-5be5-4ce6-be7e-4a20b3b492c9"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:13:52.777195 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-9868a825-b02d-416a-875a-afb5e90ee2c1 req-56c03fe2-44aa-47e5-8299-29ff3fc46d46 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:52.777635 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-9868a825-b02d-416a-875a-afb5e90ee2c1 req-56c03fe2-44aa-47e5-8299-29ff3fc46d46 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:52.792460 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-9868a825-b02d-416a-875a-afb5e90ee2c1 req-56c03fe2-44aa-47e5-8299-29ff3fc46d46 service nova] Creating event network-vif-deleted:d160f76f-5be5-4ce6-be7e-4a20b3b492c9 for instance 55f7f013-449c-4054-b481-780884c79d4a on hv-cinder-83538 Jun 23 17:13:52.798968 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-9868a825-b02d-416a-875a-afb5e90ee2c1 req-56c03fe2-44aa-47e5-8299-29ff3fc46d46 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035082 Jun 23 17:13:52.800394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 140/280] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:13:53.349937 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-00210a81-59ba-47fd-8bed-d33cfd57fd07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:53.350522 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-00210a81-59ba-47fd-8bed-d33cfd57fd07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:53.357739 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-00210a81-59ba-47fd-8bed-d33cfd57fd07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:53.358224 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-00210a81-59ba-47fd-8bed-d33cfd57fd07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:53.359106 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-00210a81-59ba-47fd-8bed-d33cfd57fd07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:53.359576 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-00210a81-59ba-47fd-8bed-d33cfd57fd07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:53.396019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-00210a81-59ba-47fd-8bed-d33cfd57fd07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:53.396460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-00210a81-59ba-47fd-8bed-d33cfd57fd07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:53.396904 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-00210a81-59ba-47fd-8bed-d33cfd57fd07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lazy-loading 'fault' on Instance uuid 55f7f013-449c-4054-b481-780884c79d4a {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:13:53.439113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-00210a81-59ba-47fd-8bed-d33cfd57fd07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:53.446745 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-00210a81-59ba-47fd-8bed-d33cfd57fd07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 200 len: 1303 microversion: 2.1 time: 0.100996 Jun 23 17:13:53.447336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 141/281] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:53 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:53.476078 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e3af8fa0-30ad-496c-a914-862ed72b91af tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:53.476747 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e3af8fa0-30ad-496c-a914-862ed72b91af tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:53.483217 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e3af8fa0-30ad-496c-a914-862ed72b91af tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:53.483663 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e3af8fa0-30ad-496c-a914-862ed72b91af tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:53.484411 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e3af8fa0-30ad-496c-a914-862ed72b91af tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:53.484844 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e3af8fa0-30ad-496c-a914-862ed72b91af tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:53.548544 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e3af8fa0-30ad-496c-a914-862ed72b91af tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:53.556270 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e3af8fa0-30ad-496c-a914-862ed72b91af tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1266 microversion: 2.1 time: 0.084502 Jun 23 17:13:53.556833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 141/282] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:53 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:13:53.756387 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6fd02dfb-c991-4cc5-a18c-ed7e19f3daf0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:53.757228 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6fd02dfb-c991-4cc5-a18c-ed7e19f3daf0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:53.779279 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6fd02dfb-c991-4cc5-a18c-ed7e19f3daf0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:53.779740 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6fd02dfb-c991-4cc5-a18c-ed7e19f3daf0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:53.780626 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6fd02dfb-c991-4cc5-a18c-ed7e19f3daf0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:53.780961 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6fd02dfb-c991-4cc5-a18c-ed7e19f3daf0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:53.960323 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:54.105151 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6fd02dfb-c991-4cc5-a18c-ed7e19f3daf0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:54.113552 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6fd02dfb-c991-4cc5-a18c-ed7e19f3daf0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.361446 Jun 23 17:13:54.114080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 142/283] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:53 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:13:54.465501 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3d874456-f20c-4eee-83b3-b8b23fbd4c12 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:54.466238 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3d874456-f20c-4eee-83b3-b8b23fbd4c12 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 55f7f013-449c-4054-b481-780884c79d4a] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:54.472954 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d874456-f20c-4eee-83b3-b8b23fbd4c12 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:54.473758 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d874456-f20c-4eee-83b3-b8b23fbd4c12 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:54.474637 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d874456-f20c-4eee-83b3-b8b23fbd4c12 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:54.475066 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d874456-f20c-4eee-83b3-b8b23fbd4c12 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:54.489153 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-3d874456-f20c-4eee-83b3-b8b23fbd4c12 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] HTTP exception thrown: Instance 55f7f013-449c-4054-b481-780884c79d4a could not be found. Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3d874456-f20c-4eee-83b3-b8b23fbd4c12 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Request method failure captured: Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a HTTP/1.1 Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ8x9-9N1mvfWxH30CplXn2yDjGyrAlTE3YSRrgwXHd6ZaQ3xM8FNWpU22GYvPB3-ZO4H29y10W5bDUgJdwcj4NbuA4aHbrbhxL51G1lhbrqGHeYC79Zml5P2rh5EtRffq-fnsNHijvSKpHyMqCTMObh-mW8t_JJ3bl4_UPPWWmMzoE Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: aa636b31dd844b93b83300a3de1418ce Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-VolumesActionsTest-1185832151 Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:13:54.491512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:13:54.492991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aa636b31dd844b93b83300a3de1418ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aa636b31dd844b93b83300a3de1418ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aa636b31dd844b93b83300a3de1418ce", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aa636b31dd844b93b83300a3de1418ce"}]}] Jun 23 17:13:54.492991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-VolumesActionsTest-1185832151 Jun 23 17:13:54.492991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: aa636b31dd844b93b83300a3de1418ce Jun 23 17:13:54.492991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-VolumesActionsTest-1185832151 Jun 23 17:13:54.492991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-VolumesActionsTest-1185832151-project Jun 23 17:13:54.492991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:13:54.492991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:13:54.492991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 89d1af25b199404b9f432b21c825b447 Jun 23 17:13:54.492991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-VolumesActionsTest-1185832151-project Jun 23 17:13:54.492991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:13:54.492991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance 55f7f013-449c-4054-b481-780884c79d4a could not be found. Jun 23 17:13:54.492991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '55f7f013-449c-4054-b481-780884c79d4a'} Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f7f013-449c-4054-b481-780884c79d4a could not be found. Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:13:54.493780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f7f013-449c-4054-b481-780884c79d4a could not be found. Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f7f013-449c-4054-b481-780884c79d4a could not be found. Jun 23 17:13:54.495252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:13:54.496461 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3d874456-f20c-4eee-83b3-b8b23fbd4c12 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Returning 404 to user: Instance 55f7f013-449c-4054-b481-780884c79d4a could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:13:54.496461 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3d874456-f20c-4eee-83b3-b8b23fbd4c12 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a" status: 404 len: 111 microversion: 2.1 time: 0.032337 Jun 23 17:13:54.496461 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 142/284] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:54 2022] GET /compute/v2.1/servers/55f7f013-449c-4054-b481-780884c79d4a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:13:54.573961 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cc828cb5-aebe-4a78-a96a-74d11ce51be6 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:54.574571 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cc828cb5-aebe-4a78-a96a-74d11ce51be6 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:54.584100 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc828cb5-aebe-4a78-a96a-74d11ce51be6 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:54.585748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc828cb5-aebe-4a78-a96a-74d11ce51be6 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:54.586778 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc828cb5-aebe-4a78-a96a-74d11ce51be6 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:54.588173 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc828cb5-aebe-4a78-a96a-74d11ce51be6 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:54.623671 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-924307400", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "networks": [{"uuid": "61ebd6c3-bd7b-408e-b6a6-97ced763519b"}]}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:13:54.676818 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.network.neutron [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] validate_networks() for [('61ebd6c3-bd7b-408e-b6a6-97ced763519b', None, None, None, None, None)] {{(pid=117897) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:13:54.693328 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-cc828cb5-aebe-4a78-a96a-74d11ce51be6 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:54.701739 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cc828cb5-aebe-4a78-a96a-74d11ce51be6 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1272 microversion: 2.1 time: 0.131594 Jun 23 17:13:54.702348 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 143/285] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:54 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1272 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:55.084927 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Flavor limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:13:55.085716 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Image limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:13:55.086278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Flavor pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:13:55.086891 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Image pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:13:55.087607 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:13:55.101002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:55.101518 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:55.102485 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:55.103131 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:55.123546 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Getting quotas for project aa636b31dd844b93b83300a3de1418ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:13:55.131217 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Getting quotas for user 89d1af25b199404b9f432b21c825b447 and project aa636b31dd844b93b83300a3de1418ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:13:55.133533 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-85f99ac3-8343-4b24-9160-7a0c6dffdd71 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:55.134230 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-85f99ac3-8343-4b24-9160-7a0c6dffdd71 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:55.141471 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-85f99ac3-8343-4b24-9160-7a0c6dffdd71 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:55.142872 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-85f99ac3-8343-4b24-9160-7a0c6dffdd71 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:55.143704 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-85f99ac3-8343-4b24-9160-7a0c6dffdd71 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:55.144149 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-85f99ac3-8343-4b24-9160-7a0c6dffdd71 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:55.144481 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Going to run 1 instances... {{(pid=117897) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:13:55.147035 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:13:55.198945 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-8fa59582-f4e4-481a-8770-a798ff57dbae tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579124 Jun 23 17:13:55.199889 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 143/286] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:13:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 17:13:55.210392 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-de58a9ac-af5b-4e96-bd0d-e8f9572e5f47 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:55.210997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-de58a9ac-af5b-4e96-bd0d-e8f9572e5f47 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:55.295650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-de58a9ac-af5b-4e96-bd0d-e8f9572e5f47 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:55.308547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-de58a9ac-af5b-4e96-bd0d-e8f9572e5f47 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1213 microversion: 2.1 time: 0.102142 Jun 23 17:13:55.309122 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 144/287] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:55 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:55.417070 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-85f99ac3-8343-4b24-9160-7a0c6dffdd71 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:55.425424 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-85f99ac3-8343-4b24-9160-7a0c6dffdd71 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.296168 Jun 23 17:13:55.426028 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 144/288] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:55 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:13:55.719157 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a57438f1-c3c8-43eb-9a96-743cc61318e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:55.720207 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a57438f1-c3c8-43eb-9a96-743cc61318e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:55.726999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a57438f1-c3c8-43eb-9a96-743cc61318e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:55.727624 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a57438f1-c3c8-43eb-9a96-743cc61318e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:55.728420 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a57438f1-c3c8-43eb-9a96-743cc61318e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:55.729026 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a57438f1-c3c8-43eb-9a96-743cc61318e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:55.773067 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-45a46acd-85e5-417a-a44f-a5ac059d4b63 req-582bff47-1f90-448b-891b-369f8699d45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf401eb3-6a14-41c2-bdda-e9a448beba4f", "tag": "4e4bcb4f-d0ad-4995-bf5c-058c872cd9af"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:13:55.783500 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-45a46acd-85e5-417a-a44f-a5ac059d4b63 req-582bff47-1f90-448b-891b-369f8699d45f service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:55.784472 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-45a46acd-85e5-417a-a44f-a5ac059d4b63 req-582bff47-1f90-448b-891b-369f8699d45f service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:55.797276 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-45a46acd-85e5-417a-a44f-a5ac059d4b63 req-582bff47-1f90-448b-891b-369f8699d45f service nova] Creating event network-changed:4e4bcb4f-d0ad-4995-bf5c-058c872cd9af for instance bf401eb3-6a14-41c2-bdda-e9a448beba4f on hv-cinder-83538 Jun 23 17:13:55.807437 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-45a46acd-85e5-417a-a44f-a5ac059d4b63 req-582bff47-1f90-448b-891b-369f8699d45f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037953 Jun 23 17:13:55.810666 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 145/289] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:13:56.041681 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a57438f1-c3c8-43eb-9a96-743cc61318e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:56.049830 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a57438f1-c3c8-43eb-9a96-743cc61318e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.335160 Jun 23 17:13:56.050412 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 145/290] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:55 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:56.327714 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cce8b70a-e443-40d9-9057-73f0697cfe1c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:56.328538 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cce8b70a-e443-40d9-9057-73f0697cfe1c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:56.336117 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cce8b70a-e443-40d9-9057-73f0697cfe1c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:56.336687 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cce8b70a-e443-40d9-9057-73f0697cfe1c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:56.337615 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cce8b70a-e443-40d9-9057-73f0697cfe1c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:56.338169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cce8b70a-e443-40d9-9057-73f0697cfe1c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:56.405194 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-cce8b70a-e443-40d9-9057-73f0697cfe1c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:56.413038 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cce8b70a-e443-40d9-9057-73f0697cfe1c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1217 microversion: 2.1 time: 0.090576 Jun 23 17:13:56.413651 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 146/291] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:56 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:56.443068 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f4fa2b16-8fbf-45d0-b46a-da0ab5c10183 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:56.443689 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f4fa2b16-8fbf-45d0-b46a-da0ab5c10183 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:56.450235 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f4fa2b16-8fbf-45d0-b46a-da0ab5c10183 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:56.450673 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f4fa2b16-8fbf-45d0-b46a-da0ab5c10183 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:56.451393 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f4fa2b16-8fbf-45d0-b46a-da0ab5c10183 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:56.451824 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f4fa2b16-8fbf-45d0-b46a-da0ab5c10183 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:56.588454 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f4fa2b16-8fbf-45d0-b46a-da0ab5c10183 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:56.596084 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f4fa2b16-8fbf-45d0-b46a-da0ab5c10183 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.156940 Jun 23 17:13:56.596659 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 146/292] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:56 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:57.074609 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-10fa3db3-ed97-4f3d-a292-c993a651d752 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:57.075192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-10fa3db3-ed97-4f3d-a292-c993a651d752 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:57.084634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-10fa3db3-ed97-4f3d-a292-c993a651d752 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:57.085081 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-10fa3db3-ed97-4f3d-a292-c993a651d752 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:57.085832 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-10fa3db3-ed97-4f3d-a292-c993a651d752 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:57.086300 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-10fa3db3-ed97-4f3d-a292-c993a651d752 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:57.213459 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-10fa3db3-ed97-4f3d-a292-c993a651d752 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:57.221598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-10fa3db3-ed97-4f3d-a292-c993a651d752 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.153357 Jun 23 17:13:57.222308 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 147/293] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:57 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:57.430377 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-454ca392-1ef2-4bd7-a361-40943fcb74d1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:57.430957 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-454ca392-1ef2-4bd7-a361-40943fcb74d1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:57.436880 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-454ca392-1ef2-4bd7-a361-40943fcb74d1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:57.437663 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-454ca392-1ef2-4bd7-a361-40943fcb74d1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:57.438442 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-454ca392-1ef2-4bd7-a361-40943fcb74d1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:57.438866 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-454ca392-1ef2-4bd7-a361-40943fcb74d1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:57.503582 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-454ca392-1ef2-4bd7-a361-40943fcb74d1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:57.511109 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-454ca392-1ef2-4bd7-a361-40943fcb74d1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1217 microversion: 2.1 time: 0.084776 Jun 23 17:13:57.511669 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 147/294] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:57 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:57.616871 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6236cdbd-da25-4d75-af95-8e5b460c252e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:57.617664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6236cdbd-da25-4d75-af95-8e5b460c252e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:57.626420 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6236cdbd-da25-4d75-af95-8e5b460c252e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:57.626921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6236cdbd-da25-4d75-af95-8e5b460c252e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:57.627914 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6236cdbd-da25-4d75-af95-8e5b460c252e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:57.628482 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6236cdbd-da25-4d75-af95-8e5b460c252e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:57.773442 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6236cdbd-da25-4d75-af95-8e5b460c252e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:57.781914 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6236cdbd-da25-4d75-af95-8e5b460c252e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.170824 Jun 23 17:13:57.782134 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 148/295] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:57 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:58.242954 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-988dfc1a-fdce-4f07-924a-48cd16dfd1d0 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:58.243970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-988dfc1a-fdce-4f07-924a-48cd16dfd1d0 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:58.254261 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-988dfc1a-fdce-4f07-924a-48cd16dfd1d0 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:58.255028 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-988dfc1a-fdce-4f07-924a-48cd16dfd1d0 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:58.256358 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-988dfc1a-fdce-4f07-924a-48cd16dfd1d0 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:58.257114 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-988dfc1a-fdce-4f07-924a-48cd16dfd1d0 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:58.394092 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-988dfc1a-fdce-4f07-924a-48cd16dfd1d0 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:58.405854 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-988dfc1a-fdce-4f07-924a-48cd16dfd1d0 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.169380 Jun 23 17:13:58.406654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 148/296] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:58 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:58.529864 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-29c2177a-7cee-41e6-b8e4-4d5e7ec18d30 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:58.530558 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-29c2177a-7cee-41e6-b8e4-4d5e7ec18d30 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:58.541672 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-29c2177a-7cee-41e6-b8e4-4d5e7ec18d30 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:58.542190 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-29c2177a-7cee-41e6-b8e4-4d5e7ec18d30 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:58.543009 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-29c2177a-7cee-41e6-b8e4-4d5e7ec18d30 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:58.543442 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-29c2177a-7cee-41e6-b8e4-4d5e7ec18d30 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:58.604403 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-29c2177a-7cee-41e6-b8e4-4d5e7ec18d30 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:58.612432 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-29c2177a-7cee-41e6-b8e4-4d5e7ec18d30 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1217 microversion: 2.1 time: 0.089118 Jun 23 17:13:58.612998 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 149/297] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:58 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:58.802740 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b7ef7a6c-e814-45f1-9f8b-88091da7b34d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:58.803297 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b7ef7a6c-e814-45f1-9f8b-88091da7b34d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:58.809911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b7ef7a6c-e814-45f1-9f8b-88091da7b34d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:58.810356 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b7ef7a6c-e814-45f1-9f8b-88091da7b34d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:58.811110 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b7ef7a6c-e814-45f1-9f8b-88091da7b34d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:58.811559 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b7ef7a6c-e814-45f1-9f8b-88091da7b34d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:58.815898 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:58.948683 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b7ef7a6c-e814-45f1-9f8b-88091da7b34d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:58.956255 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b7ef7a6c-e814-45f1-9f8b-88091da7b34d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.160153 Jun 23 17:13:58.956810 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 149/298] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:58 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:59.427298 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-36c30ef0-4a7d-43d4-8080-41a5da7eb405 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:59.428474 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-36c30ef0-4a7d-43d4-8080-41a5da7eb405 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:59.439229 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-36c30ef0-4a7d-43d4-8080-41a5da7eb405 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:59.439958 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-36c30ef0-4a7d-43d4-8080-41a5da7eb405 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:59.441187 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-36c30ef0-4a7d-43d4-8080-41a5da7eb405 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:59.441946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-36c30ef0-4a7d-43d4-8080-41a5da7eb405 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:59.574319 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-36c30ef0-4a7d-43d4-8080-41a5da7eb405 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:59.581895 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-36c30ef0-4a7d-43d4-8080-41a5da7eb405 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.161389 Jun 23 17:13:59.582462 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 150/299] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:59 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:59.629097 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-71bab347-fee1-47fe-9657-4397a374f6b0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:59.629700 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-71bab347-fee1-47fe-9657-4397a374f6b0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:59.636167 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71bab347-fee1-47fe-9657-4397a374f6b0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:59.636612 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71bab347-fee1-47fe-9657-4397a374f6b0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:59.637363 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71bab347-fee1-47fe-9657-4397a374f6b0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:59.637829 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71bab347-fee1-47fe-9657-4397a374f6b0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:59.706406 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-71bab347-fee1-47fe-9657-4397a374f6b0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:13:59.715338 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-71bab347-fee1-47fe-9657-4397a374f6b0 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1217 microversion: 2.1 time: 0.090067 Jun 23 17:13:59.715868 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 150/300] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:59 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:13:59.973318 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-03d6e405-7555-4509-9bf7-774126af38c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:13:59.973952 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-03d6e405-7555-4509-9bf7-774126af38c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:13:59.980243 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-03d6e405-7555-4509-9bf7-774126af38c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:59.980664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-03d6e405-7555-4509-9bf7-774126af38c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:13:59.981412 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-03d6e405-7555-4509-9bf7-774126af38c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:13:59.981868 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-03d6e405-7555-4509-9bf7-774126af38c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:00.117314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-03d6e405-7555-4509-9bf7-774126af38c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:00.125227 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-03d6e405-7555-4509-9bf7-774126af38c1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.155720 Jun 23 17:14:00.125985 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 151/301] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:13:59 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:00.598743 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-01516f93-94e0-4af2-8d77-535f8379b92b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:00.599343 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-01516f93-94e0-4af2-8d77-535f8379b92b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:00.607584 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-01516f93-94e0-4af2-8d77-535f8379b92b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:00.607976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-01516f93-94e0-4af2-8d77-535f8379b92b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:00.608726 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-01516f93-94e0-4af2-8d77-535f8379b92b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:00.609150 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-01516f93-94e0-4af2-8d77-535f8379b92b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:00.734224 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7c80cc89-8750-4b6b-a3c5-1c0412a50311 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:00.734892 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7c80cc89-8750-4b6b-a3c5-1c0412a50311 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:00.743345 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7c80cc89-8750-4b6b-a3c5-1c0412a50311 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:00.744080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7c80cc89-8750-4b6b-a3c5-1c0412a50311 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:00.745048 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7c80cc89-8750-4b6b-a3c5-1c0412a50311 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:00.745720 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7c80cc89-8750-4b6b-a3c5-1c0412a50311 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:00.767972 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-01516f93-94e0-4af2-8d77-535f8379b92b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:00.778360 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-01516f93-94e0-4af2-8d77-535f8379b92b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.183388 Jun 23 17:14:00.785981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 151/302] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:00 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:00.820117 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7c80cc89-8750-4b6b-a3c5-1c0412a50311 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:00.827630 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7c80cc89-8750-4b6b-a3c5-1c0412a50311 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1209 microversion: 2.1 time: 0.098836 Jun 23 17:14:00.828247 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 152/303] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:00 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:14:01.145625 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-120d1b4b-cb36-49ed-ac15-8636298a431e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:01.146890 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-120d1b4b-cb36-49ed-ac15-8636298a431e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:01.153943 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-120d1b4b-cb36-49ed-ac15-8636298a431e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:01.154410 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-120d1b4b-cb36-49ed-ac15-8636298a431e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:01.155211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-120d1b4b-cb36-49ed-ac15-8636298a431e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:01.155664 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-120d1b4b-cb36-49ed-ac15-8636298a431e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:01.319595 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-120d1b4b-cb36-49ed-ac15-8636298a431e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:01.327094 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-120d1b4b-cb36-49ed-ac15-8636298a431e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.187932 Jun 23 17:14:01.327858 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 152/304] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:01 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:01.795644 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5d595af2-f2df-4051-b948-5817c80a2cce tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:01.796855 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5d595af2-f2df-4051-b948-5817c80a2cce tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:01.811658 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d595af2-f2df-4051-b948-5817c80a2cce tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:01.812762 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d595af2-f2df-4051-b948-5817c80a2cce tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:01.813776 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d595af2-f2df-4051-b948-5817c80a2cce tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:01.814276 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d595af2-f2df-4051-b948-5817c80a2cce tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:01.850500 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-2f7240d6-8d64-4b87-b4bc-746dd4b3c967 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:01.851211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-2f7240d6-8d64-4b87-b4bc-746dd4b3c967 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:01.860790 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2f7240d6-8d64-4b87-b4bc-746dd4b3c967 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:01.861506 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2f7240d6-8d64-4b87-b4bc-746dd4b3c967 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:01.862563 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2f7240d6-8d64-4b87-b4bc-746dd4b3c967 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:01.863436 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2f7240d6-8d64-4b87-b4bc-746dd4b3c967 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:01.978442 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2f7240d6-8d64-4b87-b4bc-746dd4b3c967 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:01.991430 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-2f7240d6-8d64-4b87-b4bc-746dd4b3c967 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1283 microversion: 2.1 time: 0.149515 Jun 23 17:14:01.994847 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 153/305] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:01 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1283 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:02.303532 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:02.326305 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:02.337272 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5d595af2-f2df-4051-b948-5817c80a2cce tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:02.347275 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a69aa87d-9e95-43e2-a54e-c67a86858ef7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:02.348046 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a69aa87d-9e95-43e2-a54e-c67a86858ef7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:02.356697 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a69aa87d-9e95-43e2-a54e-c67a86858ef7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:02.357390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a69aa87d-9e95-43e2-a54e-c67a86858ef7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:02.358174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a69aa87d-9e95-43e2-a54e-c67a86858ef7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:02.358599 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a69aa87d-9e95-43e2-a54e-c67a86858ef7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:02.360043 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5d595af2-f2df-4051-b948-5817c80a2cce tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.568442 Jun 23 17:14:02.361450 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 153/306] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:01 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:02.504844 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a69aa87d-9e95-43e2-a54e-c67a86858ef7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:02.512731 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a69aa87d-9e95-43e2-a54e-c67a86858ef7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.171525 Jun 23 17:14:02.513295 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 154/307] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:02 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:03.008685 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5799cd54-dc50-4d9d-85f6-2743d0c0f658 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:03.009426 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5799cd54-dc50-4d9d-85f6-2743d0c0f658 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:03.015756 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5799cd54-dc50-4d9d-85f6-2743d0c0f658 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:03.016201 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5799cd54-dc50-4d9d-85f6-2743d0c0f658 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:03.016933 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5799cd54-dc50-4d9d-85f6-2743d0c0f658 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:03.017514 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5799cd54-dc50-4d9d-85f6-2743d0c0f658 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:03.256218 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5799cd54-dc50-4d9d-85f6-2743d0c0f658 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:03.264093 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5799cd54-dc50-4d9d-85f6-2743d0c0f658 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.259368 Jun 23 17:14:03.264656 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 154/308] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:03 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:03.378430 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-36d55388-f0fa-40c6-befd-2d573697b044 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:03.379050 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-36d55388-f0fa-40c6-befd-2d573697b044 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:03.385360 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-36d55388-f0fa-40c6-befd-2d573697b044 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:03.385834 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-36d55388-f0fa-40c6-befd-2d573697b044 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:03.386573 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-36d55388-f0fa-40c6-befd-2d573697b044 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:03.386996 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-36d55388-f0fa-40c6-befd-2d573697b044 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:03.526757 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-36d55388-f0fa-40c6-befd-2d573697b044 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:03.528857 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-29e6a0a6-f178-4e54-a973-2b72bcfa5fd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:03.529825 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-29e6a0a6-f178-4e54-a973-2b72bcfa5fd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:03.536317 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-36d55388-f0fa-40c6-befd-2d573697b044 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.161735 Jun 23 17:14:03.537122 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 155/309] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:03 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:03.537318 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-29e6a0a6-f178-4e54-a973-2b72bcfa5fd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:03.537974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-29e6a0a6-f178-4e54-a973-2b72bcfa5fd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:03.538980 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-29e6a0a6-f178-4e54-a973-2b72bcfa5fd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:03.539363 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-29e6a0a6-f178-4e54-a973-2b72bcfa5fd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:03.702674 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-29e6a0a6-f178-4e54-a973-2b72bcfa5fd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:03.714118 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-29e6a0a6-f178-4e54-a973-2b72bcfa5fd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.188818 Jun 23 17:14:03.714868 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 155/310] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:03 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:04.284465 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ca3b4d62-f5aa-4a99-a5de-7baeb71378d7 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:04.284998 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ca3b4d62-f5aa-4a99-a5de-7baeb71378d7 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:04.291859 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca3b4d62-f5aa-4a99-a5de-7baeb71378d7 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:04.292304 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca3b4d62-f5aa-4a99-a5de-7baeb71378d7 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:04.293083 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca3b4d62-f5aa-4a99-a5de-7baeb71378d7 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:04.293494 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca3b4d62-f5aa-4a99-a5de-7baeb71378d7 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:04.427021 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ca3b4d62-f5aa-4a99-a5de-7baeb71378d7 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:04.437869 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ca3b4d62-f5aa-4a99-a5de-7baeb71378d7 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.157472 Jun 23 17:14:04.438649 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 156/311] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:04 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:04.553073 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f27bcf0a-b4e1-4132-8dfa-5c0bc2e0f9c4 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:04.553706 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f27bcf0a-b4e1-4132-8dfa-5c0bc2e0f9c4 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:04.561386 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f27bcf0a-b4e1-4132-8dfa-5c0bc2e0f9c4 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:04.562507 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f27bcf0a-b4e1-4132-8dfa-5c0bc2e0f9c4 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:04.563357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f27bcf0a-b4e1-4132-8dfa-5c0bc2e0f9c4 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:04.563888 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f27bcf0a-b4e1-4132-8dfa-5c0bc2e0f9c4 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:04.711995 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f27bcf0a-b4e1-4132-8dfa-5c0bc2e0f9c4 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:04.720030 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f27bcf0a-b4e1-4132-8dfa-5c0bc2e0f9c4 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.171058 Jun 23 17:14:04.720843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 156/312] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:04 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:04.734794 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7628c7bb-ef7e-4263-ac27-d1e4c4d66764 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:04.735515 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7628c7bb-ef7e-4263-ac27-d1e4c4d66764 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:04.737664 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:04.743307 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7628c7bb-ef7e-4263-ac27-d1e4c4d66764 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:04.743751 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7628c7bb-ef7e-4263-ac27-d1e4c4d66764 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:04.744512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7628c7bb-ef7e-4263-ac27-d1e4c4d66764 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:04.744937 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7628c7bb-ef7e-4263-ac27-d1e4c4d66764 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:04.887847 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7628c7bb-ef7e-4263-ac27-d1e4c4d66764 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:04.895801 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7628c7bb-ef7e-4263-ac27-d1e4c4d66764 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.164857 Jun 23 17:14:04.896424 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 157/313] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:04 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:05.457135 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5cb4a9fa-9853-42e5-a7b4-4c839b499a7c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:05.458728 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5cb4a9fa-9853-42e5-a7b4-4c839b499a7c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:05.468508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5cb4a9fa-9853-42e5-a7b4-4c839b499a7c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:05.469014 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5cb4a9fa-9853-42e5-a7b4-4c839b499a7c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:05.470029 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5cb4a9fa-9853-42e5-a7b4-4c839b499a7c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:05.470776 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5cb4a9fa-9853-42e5-a7b4-4c839b499a7c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:05.673329 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5cb4a9fa-9853-42e5-a7b4-4c839b499a7c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:05.681369 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5cb4a9fa-9853-42e5-a7b4-4c839b499a7c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.229727 Jun 23 17:14:05.682316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 157/314] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:05 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:05.737446 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9aa11411-1c7e-42b0-81b4-7d083741d07a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:05.738082 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9aa11411-1c7e-42b0-81b4-7d083741d07a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:05.740331 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=2 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:05.741470 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=10 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:05.747296 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9aa11411-1c7e-42b0-81b4-7d083741d07a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:05.747741 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9aa11411-1c7e-42b0-81b4-7d083741d07a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:05.748689 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9aa11411-1c7e-42b0-81b4-7d083741d07a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:05.749121 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9aa11411-1c7e-42b0-81b4-7d083741d07a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:05.884311 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9aa11411-1c7e-42b0-81b4-7d083741d07a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:05.892260 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9aa11411-1c7e-42b0-81b4-7d083741d07a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.159178 Jun 23 17:14:05.893083 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 158/315] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:05 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:05.912964 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cb833f80-377b-4525-9bf1-ab82e9e260d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:05.914940 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cb833f80-377b-4525-9bf1-ab82e9e260d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:05.917489 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:05.924053 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cb833f80-377b-4525-9bf1-ab82e9e260d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:05.924702 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cb833f80-377b-4525-9bf1-ab82e9e260d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:05.925677 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cb833f80-377b-4525-9bf1-ab82e9e260d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:05.926307 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cb833f80-377b-4525-9bf1-ab82e9e260d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:06.084263 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-cb833f80-377b-4525-9bf1-ab82e9e260d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:06.093594 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cb833f80-377b-4525-9bf1-ab82e9e260d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.184997 Jun 23 17:14:06.094204 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 158/316] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:05 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:06.702577 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-82c68894-b721-4f05-b820-0537988d64be tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:06.703481 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-82c68894-b721-4f05-b820-0537988d64be tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:06.720909 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-82c68894-b721-4f05-b820-0537988d64be tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:06.724439 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-82c68894-b721-4f05-b820-0537988d64be tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:06.727528 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-82c68894-b721-4f05-b820-0537988d64be tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:06.729239 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-82c68894-b721-4f05-b820-0537988d64be tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:06.913996 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f5979bb4-8b6f-4983-b39b-02731ed24811 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:06.914653 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f5979bb4-8b6f-4983-b39b-02731ed24811 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:06.927064 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f5979bb4-8b6f-4983-b39b-02731ed24811 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:06.931034 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f5979bb4-8b6f-4983-b39b-02731ed24811 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:06.932802 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f5979bb4-8b6f-4983-b39b-02731ed24811 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:06.933971 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f5979bb4-8b6f-4983-b39b-02731ed24811 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:07.029549 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:07.157288 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-82c68894-b721-4f05-b820-0537988d64be tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:07.170819 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-82c68894-b721-4f05-b820-0537988d64be tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.474965 Jun 23 17:14:07.172229 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 159/317] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:06 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:07.184455 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f472c70c-2608-4a67-b232-faae811330bd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:07.185311 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f472c70c-2608-4a67-b232-faae811330bd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:07.193423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f472c70c-2608-4a67-b232-faae811330bd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:07.194607 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f472c70c-2608-4a67-b232-faae811330bd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:07.195722 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f472c70c-2608-4a67-b232-faae811330bd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:07.196358 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f472c70c-2608-4a67-b232-faae811330bd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:07.274288 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f5979bb4-8b6f-4983-b39b-02731ed24811 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:07.284928 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f5979bb4-8b6f-4983-b39b-02731ed24811 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.378176 Jun 23 17:14:07.288672 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 159/318] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:06 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:14:07.442587 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f472c70c-2608-4a67-b232-faae811330bd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:07.454667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f472c70c-2608-4a67-b232-faae811330bd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.278970 Jun 23 17:14:07.455265 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 160/319] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:07 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:07.724642 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-b41e619f-590f-44f1-9558-b1cacfb1bbc8 req-d75013b8-9d23-444f-8a2f-242bfdd443e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7546dd4f-e528-4cbe-914c-a1f008219334", "tag": "4d534458-e5c6-486b-b395-5ee1cf6a3416"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:14:07.734431 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b41e619f-590f-44f1-9558-b1cacfb1bbc8 req-d75013b8-9d23-444f-8a2f-242bfdd443e2 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:07.735109 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b41e619f-590f-44f1-9558-b1cacfb1bbc8 req-d75013b8-9d23-444f-8a2f-242bfdd443e2 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:07.749586 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-b41e619f-590f-44f1-9558-b1cacfb1bbc8 req-d75013b8-9d23-444f-8a2f-242bfdd443e2 service nova] Creating event network-changed:4d534458-e5c6-486b-b395-5ee1cf6a3416 for instance 7546dd4f-e528-4cbe-914c-a1f008219334 on hv-cinder-83538 Jun 23 17:14:07.755616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-b41e619f-590f-44f1-9558-b1cacfb1bbc8 req-d75013b8-9d23-444f-8a2f-242bfdd443e2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034694 Jun 23 17:14:07.757013 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 160/320] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:14:08.193132 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9ca6a836-64b6-46ad-bb73-2fa3638cf0f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:08.194750 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9ca6a836-64b6-46ad-bb73-2fa3638cf0f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:08.207416 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9ca6a836-64b6-46ad-bb73-2fa3638cf0f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:08.207865 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9ca6a836-64b6-46ad-bb73-2fa3638cf0f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:08.208635 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9ca6a836-64b6-46ad-bb73-2fa3638cf0f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:08.210402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9ca6a836-64b6-46ad-bb73-2fa3638cf0f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:08.307970 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0a05ba37-c9ec-4d66-aa81-f250adea893d tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:08.309596 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0a05ba37-c9ec-4d66-aa81-f250adea893d tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:08.327583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0a05ba37-c9ec-4d66-aa81-f250adea893d tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:08.329566 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0a05ba37-c9ec-4d66-aa81-f250adea893d tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:08.330494 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0a05ba37-c9ec-4d66-aa81-f250adea893d tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:08.332236 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0a05ba37-c9ec-4d66-aa81-f250adea893d tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:08.475768 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9ca6a836-64b6-46ad-bb73-2fa3638cf0f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:08.489691 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9ca6a836-64b6-46ad-bb73-2fa3638cf0f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.302213 Jun 23 17:14:08.490603 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 161/321] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:08 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:08.496751 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fb5dcf90-a5ca-4b70-aa56-e76b6c471e20 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:08.497602 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fb5dcf90-a5ca-4b70-aa56-e76b6c471e20 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:08.514602 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fb5dcf90-a5ca-4b70-aa56-e76b6c471e20 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:08.518782 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fb5dcf90-a5ca-4b70-aa56-e76b6c471e20 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:08.521356 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fb5dcf90-a5ca-4b70-aa56-e76b6c471e20 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:08.522400 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fb5dcf90-a5ca-4b70-aa56-e76b6c471e20 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:08.539844 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0a05ba37-c9ec-4d66-aa81-f250adea893d tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:08.554225 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0a05ba37-c9ec-4d66-aa81-f250adea893d tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.251378 Jun 23 17:14:08.557087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 161/322] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:08 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:08.797013 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-fb5dcf90-a5ca-4b70-aa56-e76b6c471e20 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:08.807039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-fb5dcf90-a5ca-4b70-aa56-e76b6c471e20 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.314934 Jun 23 17:14:08.818572 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 162/323] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:08 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:09.507030 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-07bfa6f3-c4b0-4399-ba90-ec1e1de8d809 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:09.508281 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-07bfa6f3-c4b0-4399-ba90-ec1e1de8d809 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:09.523226 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07bfa6f3-c4b0-4399-ba90-ec1e1de8d809 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:09.538410 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07bfa6f3-c4b0-4399-ba90-ec1e1de8d809 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:09.542138 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07bfa6f3-c4b0-4399-ba90-ec1e1de8d809 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:09.543454 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07bfa6f3-c4b0-4399-ba90-ec1e1de8d809 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:09.573010 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-77e2d9f3-df55-42b2-af3c-8c1c69eec639 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:09.575041 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-77e2d9f3-df55-42b2-af3c-8c1c69eec639 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:09.581890 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-77e2d9f3-df55-42b2-af3c-8c1c69eec639 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:09.582581 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-77e2d9f3-df55-42b2-af3c-8c1c69eec639 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:09.583635 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-77e2d9f3-df55-42b2-af3c-8c1c69eec639 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:09.584584 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-77e2d9f3-df55-42b2-af3c-8c1c69eec639 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:09.786159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-07bfa6f3-c4b0-4399-ba90-ec1e1de8d809 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:09.794486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-07bfa6f3-c4b0-4399-ba90-ec1e1de8d809 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.291287 Jun 23 17:14:09.798209 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 162/324] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:09 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:09.826473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7b3afa6f-237a-4303-8c09-db122d36a899 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:09.827882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7b3afa6f-237a-4303-8c09-db122d36a899 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:09.834973 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7b3afa6f-237a-4303-8c09-db122d36a899 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:09.836212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7b3afa6f-237a-4303-8c09-db122d36a899 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:09.838843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7b3afa6f-237a-4303-8c09-db122d36a899 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:09.839419 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7b3afa6f-237a-4303-8c09-db122d36a899 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:09.848378 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-77e2d9f3-df55-42b2-af3c-8c1c69eec639 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:09.862041 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-77e2d9f3-df55-42b2-af3c-8c1c69eec639 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.289981 Jun 23 17:14:09.872420 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 163/325] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:09 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:10.008478 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7b3afa6f-237a-4303-8c09-db122d36a899 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:10.019761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7b3afa6f-237a-4303-8c09-db122d36a899 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.198514 Jun 23 17:14:10.021696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 163/326] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:09 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:14:10.815659 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-71a66b67-6e68-47d4-8a64-b16c7dbfb34f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:10.816957 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-71a66b67-6e68-47d4-8a64-b16c7dbfb34f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:10.824799 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71a66b67-6e68-47d4-8a64-b16c7dbfb34f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:10.825877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71a66b67-6e68-47d4-8a64-b16c7dbfb34f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:10.826731 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71a66b67-6e68-47d4-8a64-b16c7dbfb34f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:10.827277 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71a66b67-6e68-47d4-8a64-b16c7dbfb34f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:10.889535 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-53aee71a-f3bd-48ad-978c-72c9d6317a60 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:10.889535 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-53aee71a-f3bd-48ad-978c-72c9d6317a60 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:10.889535 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-53aee71a-f3bd-48ad-978c-72c9d6317a60 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:10.890280 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-53aee71a-f3bd-48ad-978c-72c9d6317a60 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:10.890983 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-53aee71a-f3bd-48ad-978c-72c9d6317a60 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:10.891507 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-53aee71a-f3bd-48ad-978c-72c9d6317a60 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:11.057096 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-71a66b67-6e68-47d4-8a64-b16c7dbfb34f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:11.068330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-71a66b67-6e68-47d4-8a64-b16c7dbfb34f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.257661 Jun 23 17:14:11.068861 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 164/327] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:10 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:11.072983 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-53aee71a-f3bd-48ad-978c-72c9d6317a60 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:11.081587 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-42045ee9-d052-4411-ba77-5f3bea736881 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:11.082229 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-42045ee9-d052-4411-ba77-5f3bea736881 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:11.085211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-53aee71a-f3bd-48ad-978c-72c9d6317a60 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.209590 Jun 23 17:14:11.089288 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-42045ee9-d052-4411-ba77-5f3bea736881 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:11.089964 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-42045ee9-d052-4411-ba77-5f3bea736881 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:11.090881 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-42045ee9-d052-4411-ba77-5f3bea736881 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:11.091469 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-42045ee9-d052-4411-ba77-5f3bea736881 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:11.094616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 164/328] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:10 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:11.391632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-42045ee9-d052-4411-ba77-5f3bea736881 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:11.401532 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:11.423808 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-42045ee9-d052-4411-ba77-5f3bea736881 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.346035 Jun 23 17:14:11.425544 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 165/329] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:11 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:12.085241 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ba725280-c8fd-4ac9-882c-5d2305620893 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:12.085775 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ba725280-c8fd-4ac9-882c-5d2305620893 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:12.093817 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ba725280-c8fd-4ac9-882c-5d2305620893 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:12.094319 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ba725280-c8fd-4ac9-882c-5d2305620893 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:12.095092 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ba725280-c8fd-4ac9-882c-5d2305620893 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:12.098622 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ba725280-c8fd-4ac9-882c-5d2305620893 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:12.110092 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ac2c037e-c554-473e-8202-1566287d2a9a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:12.110092 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ac2c037e-c554-473e-8202-1566287d2a9a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:12.128978 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ac2c037e-c554-473e-8202-1566287d2a9a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:12.130036 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ac2c037e-c554-473e-8202-1566287d2a9a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:12.130976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ac2c037e-c554-473e-8202-1566287d2a9a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:12.131653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ac2c037e-c554-473e-8202-1566287d2a9a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:12.290475 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ba725280-c8fd-4ac9-882c-5d2305620893 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:12.296327 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ac2c037e-c554-473e-8202-1566287d2a9a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:12.299015 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ba725280-c8fd-4ac9-882c-5d2305620893 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.218193 Jun 23 17:14:12.309278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ac2c037e-c554-473e-8202-1566287d2a9a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.209748 Jun 23 17:14:12.309278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 166/330] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:12 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:14:12.310304 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 165/331] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:12 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:12.442938 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-bde3c0ba-7408-4627-837b-c2264caad62b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:12.443401 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-bde3c0ba-7408-4627-837b-c2264caad62b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:12.450162 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bde3c0ba-7408-4627-837b-c2264caad62b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:12.450591 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bde3c0ba-7408-4627-837b-c2264caad62b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:12.451371 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bde3c0ba-7408-4627-837b-c2264caad62b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:12.451938 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bde3c0ba-7408-4627-837b-c2264caad62b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:12.659926 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-bde3c0ba-7408-4627-837b-c2264caad62b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:12.671151 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-bde3c0ba-7408-4627-837b-c2264caad62b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.232464 Jun 23 17:14:12.671741 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 167/332] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:12 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:13.318756 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0d129bd0-ee77-4a27-86c4-9575210c563f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:13.327087 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-40af54fc-a22b-4aca-afe2-8ebc7ffd536b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:13.328867 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-40af54fc-a22b-4aca-afe2-8ebc7ffd536b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:13.330446 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0d129bd0-ee77-4a27-86c4-9575210c563f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:13.341323 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-40af54fc-a22b-4aca-afe2-8ebc7ffd536b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:13.341767 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-40af54fc-a22b-4aca-afe2-8ebc7ffd536b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:13.347707 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d129bd0-ee77-4a27-86c4-9575210c563f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:13.347987 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-40af54fc-a22b-4aca-afe2-8ebc7ffd536b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:13.348666 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-40af54fc-a22b-4aca-afe2-8ebc7ffd536b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:13.349277 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d129bd0-ee77-4a27-86c4-9575210c563f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:13.350135 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d129bd0-ee77-4a27-86c4-9575210c563f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:13.350557 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d129bd0-ee77-4a27-86c4-9575210c563f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:13.499091 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0d129bd0-ee77-4a27-86c4-9575210c563f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:13.508259 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0d129bd0-ee77-4a27-86c4-9575210c563f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.194065 Jun 23 17:14:13.508844 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 166/333] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:13 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:13.569785 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-40af54fc-a22b-4aca-afe2-8ebc7ffd536b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:13.580197 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-40af54fc-a22b-4aca-afe2-8ebc7ffd536b tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.259156 Jun 23 17:14:13.598381 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 168/334] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:13 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:14:13.691003 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8aaa2306-01b1-4c11-8857-49d0c35f83f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:13.693036 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8aaa2306-01b1-4c11-8857-49d0c35f83f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:13.709135 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8aaa2306-01b1-4c11-8857-49d0c35f83f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:13.711734 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8aaa2306-01b1-4c11-8857-49d0c35f83f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:13.711734 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8aaa2306-01b1-4c11-8857-49d0c35f83f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:13.711966 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8aaa2306-01b1-4c11-8857-49d0c35f83f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:13.854398 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8aaa2306-01b1-4c11-8857-49d0c35f83f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:13.865094 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8aaa2306-01b1-4c11-8857-49d0c35f83f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.179606 Jun 23 17:14:13.866325 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 167/335] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:13 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:14.464489 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-53111343-45f0-4383-b54d-c7a168390857 req-1d4575e7-a26e-4474-8382-771485eadb24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf401eb3-6a14-41c2-bdda-e9a448beba4f", "name": "network-vif-plugged", "status": "completed", "tag": "4e4bcb4f-d0ad-4995-bf5c-058c872cd9af"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:14:14.473590 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-53111343-45f0-4383-b54d-c7a168390857 req-1d4575e7-a26e-4474-8382-771485eadb24 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:14.474281 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-53111343-45f0-4383-b54d-c7a168390857 req-1d4575e7-a26e-4474-8382-771485eadb24 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:14.487016 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-53111343-45f0-4383-b54d-c7a168390857 req-1d4575e7-a26e-4474-8382-771485eadb24 service nova] Creating event network-vif-plugged:4e4bcb4f-d0ad-4995-bf5c-058c872cd9af for instance bf401eb3-6a14-41c2-bdda-e9a448beba4f on hv-cinder-83538 Jun 23 17:14:14.492754 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-53111343-45f0-4383-b54d-c7a168390857 req-1d4575e7-a26e-4474-8382-771485eadb24 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032042 Jun 23 17:14:14.494075 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 169/336] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:14:14.524637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e5ec9fe2-e80c-417c-a279-80414da2fbbd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:14.525249 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e5ec9fe2-e80c-417c-a279-80414da2fbbd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:14.534064 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e5ec9fe2-e80c-417c-a279-80414da2fbbd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:14.535031 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e5ec9fe2-e80c-417c-a279-80414da2fbbd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:14.535917 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e5ec9fe2-e80c-417c-a279-80414da2fbbd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:14.536591 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e5ec9fe2-e80c-417c-a279-80414da2fbbd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:14.602429 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-29e467ab-d049-4144-a485-afd2ea44bb92 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:14.603361 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-29e467ab-d049-4144-a485-afd2ea44bb92 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:14.615211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-29e467ab-d049-4144-a485-afd2ea44bb92 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:14.616132 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-29e467ab-d049-4144-a485-afd2ea44bb92 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:14.617573 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-29e467ab-d049-4144-a485-afd2ea44bb92 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:14.618325 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-29e467ab-d049-4144-a485-afd2ea44bb92 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:14.808523 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e5ec9fe2-e80c-417c-a279-80414da2fbbd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:14.817294 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e5ec9fe2-e80c-417c-a279-80414da2fbbd tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.296514 Jun 23 17:14:14.826919 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 168/337] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:14 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:14.886765 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bbfd96de-b7a3-4738-990f-1d347eecd6bc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:14.886999 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bbfd96de-b7a3-4738-990f-1d347eecd6bc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:14.932647 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bbfd96de-b7a3-4738-990f-1d347eecd6bc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:14.933345 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bbfd96de-b7a3-4738-990f-1d347eecd6bc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:14.934409 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bbfd96de-b7a3-4738-990f-1d347eecd6bc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:14.934924 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bbfd96de-b7a3-4738-990f-1d347eecd6bc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:15.169692 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-29e467ab-d049-4144-a485-afd2ea44bb92 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:15.181181 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-29e467ab-d049-4144-a485-afd2ea44bb92 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.586177 Jun 23 17:14:15.191503 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 170/338] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:14 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:15.219422 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bbfd96de-b7a3-4738-990f-1d347eecd6bc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:15.228138 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bbfd96de-b7a3-4738-990f-1d347eecd6bc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.348891 Jun 23 17:14:15.228737 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 169/339] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:14 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:15.836139 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7b01f427-ef47-4aed-970a-f29ac531104b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:15.836979 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7b01f427-ef47-4aed-970a-f29ac531104b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:15.855546 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7b01f427-ef47-4aed-970a-f29ac531104b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:15.860496 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7b01f427-ef47-4aed-970a-f29ac531104b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:15.861833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7b01f427-ef47-4aed-970a-f29ac531104b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:15.862380 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7b01f427-ef47-4aed-970a-f29ac531104b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:16.200725 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-82c48c70-6520-4775-aede-2178db498e89 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:16.201894 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-82c48c70-6520-4775-aede-2178db498e89 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:16.234858 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7b01f427-ef47-4aed-970a-f29ac531104b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:16.245679 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-82c48c70-6520-4775-aede-2178db498e89 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:16.246022 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-82c48c70-6520-4775-aede-2178db498e89 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:16.248843 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7b01f427-ef47-4aed-970a-f29ac531104b tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.416386 Jun 23 17:14:16.250343 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 171/340] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:15 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:16.262134 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-82c48c70-6520-4775-aede-2178db498e89 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:16.264522 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-82c48c70-6520-4775-aede-2178db498e89 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:16.280251 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6684e990-64c1-494a-92e9-3b8f23ff44fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:16.282086 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6684e990-64c1-494a-92e9-3b8f23ff44fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:16.300830 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6684e990-64c1-494a-92e9-3b8f23ff44fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:16.302371 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6684e990-64c1-494a-92e9-3b8f23ff44fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:16.304965 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6684e990-64c1-494a-92e9-3b8f23ff44fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:16.313239 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6684e990-64c1-494a-92e9-3b8f23ff44fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:16.525465 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-82c48c70-6520-4775-aede-2178db498e89 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:16.534353 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-82c48c70-6520-4775-aede-2178db498e89 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.339352 Jun 23 17:14:16.536653 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 170/341] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:16 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:14:16.666866 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6684e990-64c1-494a-92e9-3b8f23ff44fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:16.674765 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6684e990-64c1-494a-92e9-3b8f23ff44fd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.415079 Jun 23 17:14:16.686054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 172/342] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:16 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:17.267037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5f49914f-6710-4e63-a9b5-e1c6ac36a497 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:17.268379 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5f49914f-6710-4e63-a9b5-e1c6ac36a497 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:17.275485 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f49914f-6710-4e63-a9b5-e1c6ac36a497 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:17.276383 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f49914f-6710-4e63-a9b5-e1c6ac36a497 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:17.277520 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f49914f-6710-4e63-a9b5-e1c6ac36a497 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:17.278259 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f49914f-6710-4e63-a9b5-e1c6ac36a497 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:17.553569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fb5e5c62-93c8-4573-87c8-d0cb4f689572 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:17.554217 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fb5e5c62-93c8-4573-87c8-d0cb4f689572 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:17.569846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fb5e5c62-93c8-4573-87c8-d0cb4f689572 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:17.570338 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fb5e5c62-93c8-4573-87c8-d0cb4f689572 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:17.571061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fb5e5c62-93c8-4573-87c8-d0cb4f689572 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:17.571498 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fb5e5c62-93c8-4573-87c8-d0cb4f689572 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:17.926160 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-fb5e5c62-93c8-4573-87c8-d0cb4f689572 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:17.935582 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-fb5e5c62-93c8-4573-87c8-d0cb4f689572 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.386249 Jun 23 17:14:17.940656 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 173/343] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:17 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:14:17.952406 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a9a74c32-1d6c-4d25-9cb9-b712d8d3a330 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:17.955272 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a9a74c32-1d6c-4d25-9cb9-b712d8d3a330 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:17.968882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a9a74c32-1d6c-4d25-9cb9-b712d8d3a330 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:17.969392 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a9a74c32-1d6c-4d25-9cb9-b712d8d3a330 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:17.970350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a9a74c32-1d6c-4d25-9cb9-b712d8d3a330 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:17.972107 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a9a74c32-1d6c-4d25-9cb9-b712d8d3a330 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:18.167155 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f49914f-6710-4e63-a9b5-e1c6ac36a497 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:18.175994 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5f49914f-6710-4e63-a9b5-e1c6ac36a497 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.912784 Jun 23 17:14:18.177421 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 171/344] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:17 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:18.259417 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a9a74c32-1d6c-4d25-9cb9-b712d8d3a330 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:18.268349 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a9a74c32-1d6c-4d25-9cb9-b712d8d3a330 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.326278 Jun 23 17:14:18.279909 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 174/345] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:17 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:18.959483 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3ae8caa2-134c-4df2-8999-4c28f37b0426 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:18.960532 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3ae8caa2-134c-4df2-8999-4c28f37b0426 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:18.970598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3ae8caa2-134c-4df2-8999-4c28f37b0426 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:18.971323 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3ae8caa2-134c-4df2-8999-4c28f37b0426 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:18.973184 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3ae8caa2-134c-4df2-8999-4c28f37b0426 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:18.973859 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3ae8caa2-134c-4df2-8999-4c28f37b0426 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:19.220289 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3ae8caa2-134c-4df2-8999-4c28f37b0426 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:19.233104 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3ae8caa2-134c-4df2-8999-4c28f37b0426 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.284147 Jun 23 17:14:19.238504 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 172/346] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:18 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:19.248108 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-61b86434-9ff7-4f3a-be22-6e918cab18f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:19.248727 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-61b86434-9ff7-4f3a-be22-6e918cab18f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:19.262894 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61b86434-9ff7-4f3a-be22-6e918cab18f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:19.263597 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61b86434-9ff7-4f3a-be22-6e918cab18f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:19.264728 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61b86434-9ff7-4f3a-be22-6e918cab18f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:19.265319 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61b86434-9ff7-4f3a-be22-6e918cab18f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:19.420883 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d4a42815-ff3e-4b6e-883c-204694f4807b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Action: 'create', calling method: .version_select at 0x7f342dd999d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1616861067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHX9RD5j/kVAI/4tTziHyrhU/ZG03RFccUrNBjiRGra0miWR/VE4uBXV+p+tl+WOl+kmP5J8kx9y/gBTa5/5lGVB9zU8ilWOTpyZg4YyA2YrAMqZzEhfcHp5go38nwIh+Q=="}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:14:19.439209 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-d4a42815-ff3e-4b6e-883c-204694f4807b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Getting quotas for project e456e86229d84ae28c56cf25357f99bc. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:14:19.443501 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-d4a42815-ff3e-4b6e-883c-204694f4807b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Getting quotas for user 9a1e3a5739ac4a46beb0baa8887660f5 and project e456e86229d84ae28c56cf25357f99bc. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:14:19.447019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-61b86434-9ff7-4f3a-be22-6e918cab18f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:19.460211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-61b86434-9ff7-4f3a-be22-6e918cab18f6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.219384 Jun 23 17:14:19.461280 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 173/347] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:19 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:19.466767 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4660bf2b-50a3-4799-a740-0f0a61069b18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:19.467601 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4660bf2b-50a3-4799-a740-0f0a61069b18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:19.476652 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4660bf2b-50a3-4799-a740-0f0a61069b18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:19.477324 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4660bf2b-50a3-4799-a740-0f0a61069b18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:19.478492 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4660bf2b-50a3-4799-a740-0f0a61069b18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:19.479098 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4660bf2b-50a3-4799-a740-0f0a61069b18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:19.482575 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d4a42815-ff3e-4b6e-883c-204694f4807b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.331637 Jun 23 17:14:19.489391 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 175/348] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 23 17:14:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:14:19.711091 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4660bf2b-50a3-4799-a740-0f0a61069b18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:19.731562 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4660bf2b-50a3-4799-a740-0f0a61069b18 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.268879 Jun 23 17:14:19.732577 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 174/349] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:19 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:20.254546 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3a58aa4a-15e4-4b57-bdf6-87f54da1d0ae tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:20.255160 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3a58aa4a-15e4-4b57-bdf6-87f54da1d0ae tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:20.263651 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a58aa4a-15e4-4b57-bdf6-87f54da1d0ae tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:20.263750 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a58aa4a-15e4-4b57-bdf6-87f54da1d0ae tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:20.264490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a58aa4a-15e4-4b57-bdf6-87f54da1d0ae tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:20.264945 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a58aa4a-15e4-4b57-bdf6-87f54da1d0ae tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:20.476520 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e9531779-bf44-47bd-948c-5c549fe8e418 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:20.477120 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e9531779-bf44-47bd-948c-5c549fe8e418 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:20.487431 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9531779-bf44-47bd-948c-5c549fe8e418 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:20.488157 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9531779-bf44-47bd-948c-5c549fe8e418 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:20.488562 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3a58aa4a-15e4-4b57-bdf6-87f54da1d0ae tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:20.489991 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9531779-bf44-47bd-948c-5c549fe8e418 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:20.490909 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9531779-bf44-47bd-948c-5c549fe8e418 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:20.497932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3a58aa4a-15e4-4b57-bdf6-87f54da1d0ae tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.248076 Jun 23 17:14:20.521302 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 176/350] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:20 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:20.664295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e9531779-bf44-47bd-948c-5c549fe8e418 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:20.675502 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e9531779-bf44-47bd-948c-5c549fe8e418 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.202718 Jun 23 17:14:20.676264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 175/351] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:20 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:20.749569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4345c4a0-a0be-4bb9-a2d6-2ea31a10c767 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:20.750236 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4345c4a0-a0be-4bb9-a2d6-2ea31a10c767 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:20.757031 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4345c4a0-a0be-4bb9-a2d6-2ea31a10c767 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:20.757355 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4345c4a0-a0be-4bb9-a2d6-2ea31a10c767 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:20.758173 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4345c4a0-a0be-4bb9-a2d6-2ea31a10c767 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:20.759216 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4345c4a0-a0be-4bb9-a2d6-2ea31a10c767 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:20.949353 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4345c4a0-a0be-4bb9-a2d6-2ea31a10c767 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:20.958817 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4345c4a0-a0be-4bb9-a2d6-2ea31a10c767 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.213408 Jun 23 17:14:20.960398 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 177/352] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:20 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:21.515341 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-27a20803-8654-466b-8387-89f2a10d1d80 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:21.516734 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-27a20803-8654-466b-8387-89f2a10d1d80 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:21.532033 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-27a20803-8654-466b-8387-89f2a10d1d80 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:21.532634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-27a20803-8654-466b-8387-89f2a10d1d80 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:21.534075 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-27a20803-8654-466b-8387-89f2a10d1d80 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:21.535507 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-27a20803-8654-466b-8387-89f2a10d1d80 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:21.690047 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-27a20803-8654-466b-8387-89f2a10d1d80 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:21.694050 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3d319b24-b876-413e-a2e2-b720cab547b5 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:21.695622 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3d319b24-b876-413e-a2e2-b720cab547b5 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:21.696366 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:21.701587 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-27a20803-8654-466b-8387-89f2a10d1d80 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.190978 Jun 23 17:14:21.702200 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 176/353] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:21 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:21.703341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d319b24-b876-413e-a2e2-b720cab547b5 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:21.703914 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d319b24-b876-413e-a2e2-b720cab547b5 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:21.704685 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d319b24-b876-413e-a2e2-b720cab547b5 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:21.705316 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d319b24-b876-413e-a2e2-b720cab547b5 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:21.866347 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3d319b24-b876-413e-a2e2-b720cab547b5 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:21.874853 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3d319b24-b876-413e-a2e2-b720cab547b5 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.185715 Jun 23 17:14:21.875508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 178/354] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:21 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:14:21.976933 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2ebe5084-a59d-4637-aef1-22e360f212d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:21.977543 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2ebe5084-a59d-4637-aef1-22e360f212d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:21.988807 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ebe5084-a59d-4637-aef1-22e360f212d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:21.989777 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ebe5084-a59d-4637-aef1-22e360f212d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:21.991032 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ebe5084-a59d-4637-aef1-22e360f212d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:21.991706 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ebe5084-a59d-4637-aef1-22e360f212d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:22.148660 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2ebe5084-a59d-4637-aef1-22e360f212d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:22.159328 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2ebe5084-a59d-4637-aef1-22e360f212d0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.185953 Jun 23 17:14:22.169920 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 177/355] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:21 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:22.718077 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3d8e2951-5a31-47c1-8c01-2737da715e75 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:22.719527 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3d8e2951-5a31-47c1-8c01-2737da715e75 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:22.727871 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d8e2951-5a31-47c1-8c01-2737da715e75 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:22.728888 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d8e2951-5a31-47c1-8c01-2737da715e75 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:22.729733 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d8e2951-5a31-47c1-8c01-2737da715e75 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:22.732144 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d8e2951-5a31-47c1-8c01-2737da715e75 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:22.892073 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5f73fa69-572f-416f-b701-22c4754b1ea1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:22.893010 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5f73fa69-572f-416f-b701-22c4754b1ea1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:22.902818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f73fa69-572f-416f-b701-22c4754b1ea1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:22.906047 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f73fa69-572f-416f-b701-22c4754b1ea1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:22.907208 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f73fa69-572f-416f-b701-22c4754b1ea1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:22.907716 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f73fa69-572f-416f-b701-22c4754b1ea1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:22.941193 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3d8e2951-5a31-47c1-8c01-2737da715e75 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:22.954137 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3d8e2951-5a31-47c1-8c01-2737da715e75 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.239954 Jun 23 17:14:22.955404 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 179/356] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:22 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:23.086885 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f73fa69-572f-416f-b701-22c4754b1ea1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:23.094294 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5f73fa69-572f-416f-b701-22c4754b1ea1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.206129 Jun 23 17:14:23.096425 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 178/357] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:22 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:23.177336 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e2006f09-fd7f-40c9-91fd-3f012b28951d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:23.179409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e2006f09-fd7f-40c9-91fd-3f012b28951d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:23.190539 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e2006f09-fd7f-40c9-91fd-3f012b28951d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:23.191486 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e2006f09-fd7f-40c9-91fd-3f012b28951d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:23.192602 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e2006f09-fd7f-40c9-91fd-3f012b28951d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:23.193195 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e2006f09-fd7f-40c9-91fd-3f012b28951d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:23.434928 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e2006f09-fd7f-40c9-91fd-3f012b28951d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:23.444178 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e2006f09-fd7f-40c9-91fd-3f012b28951d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.271404 Jun 23 17:14:23.444777 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 180/358] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:23 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:23.731293 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-c52162d9-8e8a-4d73-83ad-203924e8b7e9 req-89eef7f7-cd28-45fa-b50d-21bef7b716e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7546dd4f-e528-4cbe-914c-a1f008219334", "name": "network-vif-plugged", "status": "completed", "tag": "4d534458-e5c6-486b-b395-5ee1cf6a3416"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:14:23.745259 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c52162d9-8e8a-4d73-83ad-203924e8b7e9 req-89eef7f7-cd28-45fa-b50d-21bef7b716e8 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:23.746025 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c52162d9-8e8a-4d73-83ad-203924e8b7e9 req-89eef7f7-cd28-45fa-b50d-21bef7b716e8 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:23.761289 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-c52162d9-8e8a-4d73-83ad-203924e8b7e9 req-89eef7f7-cd28-45fa-b50d-21bef7b716e8 service nova] Creating event network-vif-plugged:4d534458-e5c6-486b-b395-5ee1cf6a3416 for instance 7546dd4f-e528-4cbe-914c-a1f008219334 on hv-cinder-83538 Jun 23 17:14:23.767246 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-c52162d9-8e8a-4d73-83ad-203924e8b7e9 req-89eef7f7-cd28-45fa-b50d-21bef7b716e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040212 Jun 23 17:14:23.767862 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 179/359] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:14:23.971460 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d562979e-25ee-4517-b3f4-12500c5622a1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:23.972668 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d562979e-25ee-4517-b3f4-12500c5622a1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:23.979711 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d562979e-25ee-4517-b3f4-12500c5622a1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:23.980357 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d562979e-25ee-4517-b3f4-12500c5622a1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:23.980928 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d562979e-25ee-4517-b3f4-12500c5622a1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:23.981359 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d562979e-25ee-4517-b3f4-12500c5622a1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:24.127486 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d562979e-25ee-4517-b3f4-12500c5622a1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:24.133351 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-070810d4-8ead-459f-9288-badb90616034 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:24.134085 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-070810d4-8ead-459f-9288-badb90616034 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:24.139117 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d562979e-25ee-4517-b3f4-12500c5622a1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.171784 Jun 23 17:14:24.140250 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 181/360] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:23 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:24.150498 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-070810d4-8ead-459f-9288-badb90616034 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:24.151207 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-070810d4-8ead-459f-9288-badb90616034 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:24.151993 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-070810d4-8ead-459f-9288-badb90616034 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:24.152429 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-070810d4-8ead-459f-9288-badb90616034 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:24.306708 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-070810d4-8ead-459f-9288-badb90616034 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:24.315247 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-070810d4-8ead-459f-9288-badb90616034 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.206999 Jun 23 17:14:24.321869 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 180/361] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:24 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:24.461319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-df48130e-ec3a-4036-8c97-2b547580872d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:24.462044 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-df48130e-ec3a-4036-8c97-2b547580872d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:24.468234 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-df48130e-ec3a-4036-8c97-2b547580872d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:24.468676 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-df48130e-ec3a-4036-8c97-2b547580872d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:24.469438 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-df48130e-ec3a-4036-8c97-2b547580872d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:24.469888 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-df48130e-ec3a-4036-8c97-2b547580872d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:24.607926 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-df48130e-ec3a-4036-8c97-2b547580872d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:24.615974 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-df48130e-ec3a-4036-8c97-2b547580872d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.158856 Jun 23 17:14:24.616549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 182/362] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:24 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:25.156654 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5afe1d78-7ffa-41e4-b6ea-0485467ddbf1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:25.157179 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5afe1d78-7ffa-41e4-b6ea-0485467ddbf1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:25.164486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5afe1d78-7ffa-41e4-b6ea-0485467ddbf1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:25.164936 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5afe1d78-7ffa-41e4-b6ea-0485467ddbf1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:25.165705 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5afe1d78-7ffa-41e4-b6ea-0485467ddbf1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:25.166172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5afe1d78-7ffa-41e4-b6ea-0485467ddbf1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:25.301404 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5afe1d78-7ffa-41e4-b6ea-0485467ddbf1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:25.310043 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5afe1d78-7ffa-41e4-b6ea-0485467ddbf1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.157376 Jun 23 17:14:25.310606 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 181/363] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:25 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:25.332282 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d3decd36-5d55-4c20-9a9e-a856c5949def tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:25.332893 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d3decd36-5d55-4c20-9a9e-a856c5949def tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:25.339424 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d3decd36-5d55-4c20-9a9e-a856c5949def tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:25.339875 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d3decd36-5d55-4c20-9a9e-a856c5949def tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:25.340631 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d3decd36-5d55-4c20-9a9e-a856c5949def tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:25.341107 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d3decd36-5d55-4c20-9a9e-a856c5949def tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:25.622176 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d3decd36-5d55-4c20-9a9e-a856c5949def tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:25.630083 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d3decd36-5d55-4c20-9a9e-a856c5949def tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.301669 Jun 23 17:14:25.630640 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 183/364] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:25 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:25.632522 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-823531c6-27a1-4118-8056-7d2a031be4ca tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:25.633134 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-823531c6-27a1-4118-8056-7d2a031be4ca tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:25.639727 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-823531c6-27a1-4118-8056-7d2a031be4ca tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:25.640174 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-823531c6-27a1-4118-8056-7d2a031be4ca tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:25.640977 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-823531c6-27a1-4118-8056-7d2a031be4ca tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:25.641383 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-823531c6-27a1-4118-8056-7d2a031be4ca tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:25.781212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-823531c6-27a1-4118-8056-7d2a031be4ca tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:25.789572 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-823531c6-27a1-4118-8056-7d2a031be4ca tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.160979 Jun 23 17:14:25.790185 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 182/365] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:25 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:26.333718 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-baa4fd07-2703-455b-a386-7c6c56171b5f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:26.334802 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-baa4fd07-2703-455b-a386-7c6c56171b5f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:26.345078 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-baa4fd07-2703-455b-a386-7c6c56171b5f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:26.345859 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-baa4fd07-2703-455b-a386-7c6c56171b5f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:26.347202 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-baa4fd07-2703-455b-a386-7c6c56171b5f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:26.347916 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-baa4fd07-2703-455b-a386-7c6c56171b5f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:26.352988 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:26.484812 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-baa4fd07-2703-455b-a386-7c6c56171b5f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:26.492543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-baa4fd07-2703-455b-a386-7c6c56171b5f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.165406 Jun 23 17:14:26.493099 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 184/366] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:26 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:26.651449 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-485be7d8-7245-4130-99c9-4053dbb40168 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:26.652581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-485be7d8-7245-4130-99c9-4053dbb40168 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:26.663634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-485be7d8-7245-4130-99c9-4053dbb40168 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:26.664619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-485be7d8-7245-4130-99c9-4053dbb40168 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:26.665864 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-485be7d8-7245-4130-99c9-4053dbb40168 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:26.666606 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-485be7d8-7245-4130-99c9-4053dbb40168 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:26.807803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c0be41af-a7ea-4ad8-af70-c089cdaf2e4a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:26.808772 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c0be41af-a7ea-4ad8-af70-c089cdaf2e4a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:26.810519 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-485be7d8-7245-4130-99c9-4053dbb40168 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:26.816268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c0be41af-a7ea-4ad8-af70-c089cdaf2e4a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:26.816720 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c0be41af-a7ea-4ad8-af70-c089cdaf2e4a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:26.817683 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c0be41af-a7ea-4ad8-af70-c089cdaf2e4a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:26.818685 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c0be41af-a7ea-4ad8-af70-c089cdaf2e4a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:26.818924 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-485be7d8-7245-4130-99c9-4053dbb40168 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.174231 Jun 23 17:14:26.819521 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 183/367] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:26 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:26.955232 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c0be41af-a7ea-4ad8-af70-c089cdaf2e4a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:26.963323 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c0be41af-a7ea-4ad8-af70-c089cdaf2e4a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.160615 Jun 23 17:14:26.963885 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 185/368] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:26 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:27.508534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-923fed92-602c-4ff8-b8a2-af1d5f959b24 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:27.509140 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-923fed92-602c-4ff8-b8a2-af1d5f959b24 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:27.515523 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-923fed92-602c-4ff8-b8a2-af1d5f959b24 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:27.515911 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-923fed92-602c-4ff8-b8a2-af1d5f959b24 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:27.516670 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-923fed92-602c-4ff8-b8a2-af1d5f959b24 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:27.517103 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-923fed92-602c-4ff8-b8a2-af1d5f959b24 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:27.658193 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-923fed92-602c-4ff8-b8a2-af1d5f959b24 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:27.667857 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-923fed92-602c-4ff8-b8a2-af1d5f959b24 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.163267 Jun 23 17:14:27.668425 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 184/369] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:27 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:27.837845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-2d83a322-f283-4f28-ab9b-f91653204e8f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:27.838681 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-2d83a322-f283-4f28-ab9b-f91653204e8f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:27.847103 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2d83a322-f283-4f28-ab9b-f91653204e8f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:27.847698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2d83a322-f283-4f28-ab9b-f91653204e8f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:27.848698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2d83a322-f283-4f28-ab9b-f91653204e8f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:27.849276 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2d83a322-f283-4f28-ab9b-f91653204e8f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:27.978767 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2d83a322-f283-4f28-ab9b-f91653204e8f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:27.980500 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-dfcf16f0-3afb-4710-8229-5ddc9e89f9f0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:27.981107 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-dfcf16f0-3afb-4710-8229-5ddc9e89f9f0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:27.986292 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-2d83a322-f283-4f28-ab9b-f91653204e8f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.153743 Jun 23 17:14:27.986845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 186/370] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:27 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:27.987413 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfcf16f0-3afb-4710-8229-5ddc9e89f9f0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:27.987860 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfcf16f0-3afb-4710-8229-5ddc9e89f9f0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:27.988617 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfcf16f0-3afb-4710-8229-5ddc9e89f9f0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:27.989045 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfcf16f0-3afb-4710-8229-5ddc9e89f9f0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:28.120073 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-dfcf16f0-3afb-4710-8229-5ddc9e89f9f0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:28.131348 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-dfcf16f0-3afb-4710-8229-5ddc9e89f9f0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.154567 Jun 23 17:14:28.132078 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 185/371] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:27 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:28.689691 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d5f8d65a-92fa-4fa1-9565-822aeff5e5c1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:28.690811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d5f8d65a-92fa-4fa1-9565-822aeff5e5c1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:28.702092 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d5f8d65a-92fa-4fa1-9565-822aeff5e5c1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:28.703007 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d5f8d65a-92fa-4fa1-9565-822aeff5e5c1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:28.704638 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d5f8d65a-92fa-4fa1-9565-822aeff5e5c1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:28.705620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d5f8d65a-92fa-4fa1-9565-822aeff5e5c1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:28.848379 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d5f8d65a-92fa-4fa1-9565-822aeff5e5c1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:28.860188 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d5f8d65a-92fa-4fa1-9565-822aeff5e5c1 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1314 microversion: 2.1 time: 0.177224 Jun 23 17:14:28.860954 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 187/372] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:28 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:29.003366 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2aa24667-628c-425e-b7fc-b808cc301e17 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:29.003975 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2aa24667-628c-425e-b7fc-b808cc301e17 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:29.011109 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2aa24667-628c-425e-b7fc-b808cc301e17 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:29.011546 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2aa24667-628c-425e-b7fc-b808cc301e17 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:29.012305 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2aa24667-628c-425e-b7fc-b808cc301e17 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:29.013561 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2aa24667-628c-425e-b7fc-b808cc301e17 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:29.154194 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fc1076f9-f7cd-4421-ac12-210408e82840 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:29.154979 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fc1076f9-f7cd-4421-ac12-210408e82840 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:29.161742 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc1076f9-f7cd-4421-ac12-210408e82840 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:29.162575 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc1076f9-f7cd-4421-ac12-210408e82840 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:29.163316 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc1076f9-f7cd-4421-ac12-210408e82840 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:29.164190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc1076f9-f7cd-4421-ac12-210408e82840 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:29.173142 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2aa24667-628c-425e-b7fc-b808cc301e17 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:29.185334 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2aa24667-628c-425e-b7fc-b808cc301e17 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.185821 Jun 23 17:14:29.185940 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 186/373] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:28 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:29.313086 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-fc1076f9-f7cd-4421-ac12-210408e82840 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:29.323777 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-fc1076f9-f7cd-4421-ac12-210408e82840 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.173920 Jun 23 17:14:29.324337 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 188/374] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:29 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:14:29.878114 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b519d118-d14a-44af-97a7-4eb313ee81fb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:29.878749 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b519d118-d14a-44af-97a7-4eb313ee81fb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:29.885264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b519d118-d14a-44af-97a7-4eb313ee81fb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:29.885716 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b519d118-d14a-44af-97a7-4eb313ee81fb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:29.886506 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b519d118-d14a-44af-97a7-4eb313ee81fb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:29.886940 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b519d118-d14a-44af-97a7-4eb313ee81fb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:30.025534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b519d118-d14a-44af-97a7-4eb313ee81fb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:30.035838 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b519d118-d14a-44af-97a7-4eb313ee81fb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1464 microversion: 2.1 time: 0.161720 Jun 23 17:14:30.036411 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 187/375] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:29 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:30.078463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6068df62-329b-4c9b-aa1f-07d2affea510 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:30.078994 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6068df62-329b-4c9b-aa1f-07d2affea510 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:30.080861 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=4 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:30.086243 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6068df62-329b-4c9b-aa1f-07d2affea510 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:30.086688 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6068df62-329b-4c9b-aa1f-07d2affea510 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:30.087488 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6068df62-329b-4c9b-aa1f-07d2affea510 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:30.087948 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6068df62-329b-4c9b-aa1f-07d2affea510 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:30.114013 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6068df62-329b-4c9b-aa1f-07d2affea510 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Going to try to terminate instance {{(pid=117897) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:14:30.197385 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6068df62-329b-4c9b-aa1f-07d2affea510 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 204 len: 0 microversion: 2.1 time: 0.122622 Jun 23 17:14:30.198171 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 189/376] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:14:30 2022] DELETE /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:14:30.204016 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d207697a-9636-4bd9-bc7a-bc42dd4a51a8 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:30.204617 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d207697a-9636-4bd9-bc7a-bc42dd4a51a8 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:30.207248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d945ecd5-d53d-40d1-b85b-b44389cde1d5 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:30.207940 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d945ecd5-d53d-40d1-b85b-b44389cde1d5 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:30.210903 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d207697a-9636-4bd9-bc7a-bc42dd4a51a8 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:30.211432 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d207697a-9636-4bd9-bc7a-bc42dd4a51a8 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:30.212527 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d207697a-9636-4bd9-bc7a-bc42dd4a51a8 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:30.213016 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d207697a-9636-4bd9-bc7a-bc42dd4a51a8 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:30.214003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d945ecd5-d53d-40d1-b85b-b44389cde1d5 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:30.214436 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d945ecd5-d53d-40d1-b85b-b44389cde1d5 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:30.215203 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d945ecd5-d53d-40d1-b85b-b44389cde1d5 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:30.215627 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d945ecd5-d53d-40d1-b85b-b44389cde1d5 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:30.348099 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d207697a-9636-4bd9-bc7a-bc42dd4a51a8 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:30.349002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d945ecd5-d53d-40d1-b85b-b44389cde1d5 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:30.355886 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d207697a-9636-4bd9-bc7a-bc42dd4a51a8 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.155985 Jun 23 17:14:30.356457 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 188/377] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:30 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:30.356591 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d945ecd5-d53d-40d1-b85b-b44389cde1d5 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1470 microversion: 2.1 time: 0.153890 Jun 23 17:14:30.357103 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 190/378] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:30 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:30.360976 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2d6c4de4-0d57-4b1f-8bf9-bd83c0a55b72 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:30.361827 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2d6c4de4-0d57-4b1f-8bf9-bd83c0a55b72 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:30.367814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d6c4de4-0d57-4b1f-8bf9-bd83c0a55b72 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:30.368332 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d6c4de4-0d57-4b1f-8bf9-bd83c0a55b72 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:30.369089 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d6c4de4-0d57-4b1f-8bf9-bd83c0a55b72 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:30.369513 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d6c4de4-0d57-4b1f-8bf9-bd83c0a55b72 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:30.501712 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2d6c4de4-0d57-4b1f-8bf9-bd83c0a55b72 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:30.509545 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2d6c4de4-0d57-4b1f-8bf9-bd83c0a55b72 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.151998 Jun 23 17:14:30.510148 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 189/379] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:30 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:31.373282 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1a3b2e66-64ad-4b25-8f46-f2736836e055 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:31.373928 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0961956a-03b5-4cfd-a758-07ee351f682c tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:31.374559 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0961956a-03b5-4cfd-a758-07ee351f682c tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:31.374726 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1a3b2e66-64ad-4b25-8f46-f2736836e055 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:31.381323 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1a3b2e66-64ad-4b25-8f46-f2736836e055 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:31.381515 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0961956a-03b5-4cfd-a758-07ee351f682c tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:31.381770 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1a3b2e66-64ad-4b25-8f46-f2736836e055 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:31.381937 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0961956a-03b5-4cfd-a758-07ee351f682c tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:31.382551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1a3b2e66-64ad-4b25-8f46-f2736836e055 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:31.382772 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0961956a-03b5-4cfd-a758-07ee351f682c tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:31.382944 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1a3b2e66-64ad-4b25-8f46-f2736836e055 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:31.383206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0961956a-03b5-4cfd-a758-07ee351f682c tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:31.520931 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1a3b2e66-64ad-4b25-8f46-f2736836e055 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:31.522728 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0961956a-03b5-4cfd-a758-07ee351f682c tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:31.529616 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1a3b2e66-64ad-4b25-8f46-f2736836e055 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.160724 Jun 23 17:14:31.530186 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 191/380] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:31 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:31.530376 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0961956a-03b5-4cfd-a758-07ee351f682c tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1470 microversion: 2.1 time: 0.160537 Jun 23 17:14:31.531354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 190/381] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:31 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:31.534976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1179f3b5-9b41-4dc9-827d-76075d3ebca5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:31.535578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1179f3b5-9b41-4dc9-827d-76075d3ebca5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:31.541649 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1179f3b5-9b41-4dc9-827d-76075d3ebca5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:31.542383 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1179f3b5-9b41-4dc9-827d-76075d3ebca5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:31.543267 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1179f3b5-9b41-4dc9-827d-76075d3ebca5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:31.543713 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1179f3b5-9b41-4dc9-827d-76075d3ebca5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:31.693127 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1179f3b5-9b41-4dc9-827d-76075d3ebca5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:31.701525 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1179f3b5-9b41-4dc9-827d-76075d3ebca5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.170309 Jun 23 17:14:31.702134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 192/382] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:31 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:32.548045 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e103946c-9651-47d4-b322-3348b80312a4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:32.548668 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f773ba61-84dc-4e33-985b-98ba102fd541 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:32.549038 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e103946c-9651-47d4-b322-3348b80312a4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:32.549127 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f773ba61-84dc-4e33-985b-98ba102fd541 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:32.556619 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f773ba61-84dc-4e33-985b-98ba102fd541 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:32.556896 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e103946c-9651-47d4-b322-3348b80312a4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:32.557120 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f773ba61-84dc-4e33-985b-98ba102fd541 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:32.557431 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e103946c-9651-47d4-b322-3348b80312a4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:32.558067 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f773ba61-84dc-4e33-985b-98ba102fd541 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:32.558453 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e103946c-9651-47d4-b322-3348b80312a4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:32.558594 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f773ba61-84dc-4e33-985b-98ba102fd541 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:32.558895 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e103946c-9651-47d4-b322-3348b80312a4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:32.700748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e103946c-9651-47d4-b322-3348b80312a4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:32.703270 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f773ba61-84dc-4e33-985b-98ba102fd541 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:32.707574 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e103946c-9651-47d4-b322-3348b80312a4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.164229 Jun 23 17:14:32.708252 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 191/383] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:32 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:32.711494 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f773ba61-84dc-4e33-985b-98ba102fd541 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1470 microversion: 2.1 time: 0.166920 Jun 23 17:14:32.712549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 193/384] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:32 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:32.720451 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4bec9061-282a-4f79-8e11-4fcaf28bd73b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:32.721606 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4bec9061-282a-4f79-8e11-4fcaf28bd73b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:32.728056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4bec9061-282a-4f79-8e11-4fcaf28bd73b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:32.728509 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4bec9061-282a-4f79-8e11-4fcaf28bd73b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:32.729263 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4bec9061-282a-4f79-8e11-4fcaf28bd73b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:32.729731 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4bec9061-282a-4f79-8e11-4fcaf28bd73b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:32.864703 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4bec9061-282a-4f79-8e11-4fcaf28bd73b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:32.872457 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4bec9061-282a-4f79-8e11-4fcaf28bd73b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.156338 Jun 23 17:14:32.873241 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 192/385] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:32 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:33.730395 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-83191b36-a0d3-43f4-bae8-bb2ccc1b3d99 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:33.730998 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-83191b36-a0d3-43f4-bae8-bb2ccc1b3d99 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:33.734472 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0ea51112-14e8-4115-a0c8-b82c98d54d6e tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:33.735082 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0ea51112-14e8-4115-a0c8-b82c98d54d6e tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:33.737532 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-83191b36-a0d3-43f4-bae8-bb2ccc1b3d99 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:33.738006 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-83191b36-a0d3-43f4-bae8-bb2ccc1b3d99 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:33.738792 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-83191b36-a0d3-43f4-bae8-bb2ccc1b3d99 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:33.739218 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-83191b36-a0d3-43f4-bae8-bb2ccc1b3d99 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:33.742160 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ea51112-14e8-4115-a0c8-b82c98d54d6e tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:33.742607 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ea51112-14e8-4115-a0c8-b82c98d54d6e tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:33.743351 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ea51112-14e8-4115-a0c8-b82c98d54d6e tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:33.743783 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ea51112-14e8-4115-a0c8-b82c98d54d6e tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:33.878873 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-83191b36-a0d3-43f4-bae8-bb2ccc1b3d99 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:33.893089 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0ea51112-14e8-4115-a0c8-b82c98d54d6e tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:33.900063 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-83191b36-a0d3-43f4-bae8-bb2ccc1b3d99 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1470 microversion: 2.1 time: 0.173561 Jun 23 17:14:33.901551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 194/386] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:33 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:33.910856 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0ea51112-14e8-4115-a0c8-b82c98d54d6e tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.180444 Jun 23 17:14:33.911559 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 193/387] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:33 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:33.912447 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fba1612b-edaa-4341-a974-9ab31afbdc28 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:33.913280 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fba1612b-edaa-4341-a974-9ab31afbdc28 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:33.922554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fba1612b-edaa-4341-a974-9ab31afbdc28 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:33.923003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fba1612b-edaa-4341-a974-9ab31afbdc28 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:33.923802 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fba1612b-edaa-4341-a974-9ab31afbdc28 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:33.924254 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fba1612b-edaa-4341-a974-9ab31afbdc28 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:34.067590 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-fba1612b-edaa-4341-a974-9ab31afbdc28 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:34.076797 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-fba1612b-edaa-4341-a974-9ab31afbdc28 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.169063 Jun 23 17:14:34.077860 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 195/388] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:33 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:34.919375 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c9d31a0f-7c2c-4e39-a7a0-270c78396afb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:34.920072 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c9d31a0f-7c2c-4e39-a7a0-270c78396afb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:34.928437 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9d31a0f-7c2c-4e39-a7a0-270c78396afb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:34.928876 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9d31a0f-7c2c-4e39-a7a0-270c78396afb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:34.929629 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9d31a0f-7c2c-4e39-a7a0-270c78396afb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:34.930091 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9d31a0f-7c2c-4e39-a7a0-270c78396afb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:34.930354 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-0301d442-85d8-4188-92c6-ae8b33bed1c9 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:34.930962 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-0301d442-85d8-4188-92c6-ae8b33bed1c9 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:34.932974 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:34.937193 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:34.939153 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0301d442-85d8-4188-92c6-ae8b33bed1c9 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:34.939594 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0301d442-85d8-4188-92c6-ae8b33bed1c9 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:34.940379 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0301d442-85d8-4188-92c6-ae8b33bed1c9 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:34.943107 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0301d442-85d8-4188-92c6-ae8b33bed1c9 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:35.075451 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c9d31a0f-7c2c-4e39-a7a0-270c78396afb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:35.080243 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-0301d442-85d8-4188-92c6-ae8b33bed1c9 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:35.086133 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c9d31a0f-7c2c-4e39-a7a0-270c78396afb tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1470 microversion: 2.1 time: 0.170554 Jun 23 17:14:35.086698 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 194/389] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:34 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:35.096262 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-0301d442-85d8-4188-92c6-ae8b33bed1c9 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.161936 Jun 23 17:14:35.097729 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 196/390] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:34 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:35.101663 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7fe56094-1e69-4ac9-93d5-ecb4bedaa3af tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:35.102412 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7fe56094-1e69-4ac9-93d5-ecb4bedaa3af tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:35.108845 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7fe56094-1e69-4ac9-93d5-ecb4bedaa3af tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:35.109297 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7fe56094-1e69-4ac9-93d5-ecb4bedaa3af tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:35.110162 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7fe56094-1e69-4ac9-93d5-ecb4bedaa3af tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:35.110600 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7fe56094-1e69-4ac9-93d5-ecb4bedaa3af tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:35.257163 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7fe56094-1e69-4ac9-93d5-ecb4bedaa3af tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:35.265215 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7fe56094-1e69-4ac9-93d5-ecb4bedaa3af tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.167527 Jun 23 17:14:35.265826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 195/391] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:35 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:36.103659 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fef6d2e2-a135-4ead-b8a6-f20f47f3d716 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:36.104477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fef6d2e2-a135-4ead-b8a6-f20f47f3d716 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:36.106436 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5f66ba8f-392d-4be5-9abd-8e274718029c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:36.107224 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5f66ba8f-392d-4be5-9abd-8e274718029c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:36.111058 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=76 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:36.111206 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fef6d2e2-a135-4ead-b8a6-f20f47f3d716 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:36.111620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fef6d2e2-a135-4ead-b8a6-f20f47f3d716 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:36.112372 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fef6d2e2-a135-4ead-b8a6-f20f47f3d716 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:36.112983 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fef6d2e2-a135-4ead-b8a6-f20f47f3d716 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:36.116031 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f66ba8f-392d-4be5-9abd-8e274718029c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:36.116476 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f66ba8f-392d-4be5-9abd-8e274718029c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:36.119508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f66ba8f-392d-4be5-9abd-8e274718029c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:36.119508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f66ba8f-392d-4be5-9abd-8e274718029c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:36.275379 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-fef6d2e2-a135-4ead-b8a6-f20f47f3d716 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:36.288639 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-fef6d2e2-a135-4ead-b8a6-f20f47f3d716 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1470 microversion: 2.1 time: 0.188678 Jun 23 17:14:36.298504 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 197/392] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:36 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:14:36.306836 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3bb51673-b555-46da-8d8a-ae01db2d2b89 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:36.308226 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3bb51673-b555-46da-8d8a-ae01db2d2b89 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:36.317446 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f66ba8f-392d-4be5-9abd-8e274718029c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:36.323280 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5f66ba8f-392d-4be5-9abd-8e274718029c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.221748 Jun 23 17:14:36.323862 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 196/393] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:36 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:14:36.333429 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3bb51673-b555-46da-8d8a-ae01db2d2b89 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:36.333429 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3bb51673-b555-46da-8d8a-ae01db2d2b89 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:36.333429 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3bb51673-b555-46da-8d8a-ae01db2d2b89 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:36.333429 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3bb51673-b555-46da-8d8a-ae01db2d2b89 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:36.455472 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3bb51673-b555-46da-8d8a-ae01db2d2b89 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:36.463064 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3bb51673-b555-46da-8d8a-ae01db2d2b89 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.163135 Jun 23 17:14:36.463546 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 198/394] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:36 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:37.309773 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-abdf1410-790d-4aad-9320-adb9916e712a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:37.312217 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-abdf1410-790d-4aad-9320-adb9916e712a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:37.323988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abdf1410-790d-4aad-9320-adb9916e712a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:37.324375 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abdf1410-790d-4aad-9320-adb9916e712a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:37.325639 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abdf1410-790d-4aad-9320-adb9916e712a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:37.326400 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abdf1410-790d-4aad-9320-adb9916e712a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:37.340457 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5e6c08f3-5392-4350-9a48-9c22eb0bd2de tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:37.341703 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5e6c08f3-5392-4350-9a48-9c22eb0bd2de tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:37.349163 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5e6c08f3-5392-4350-9a48-9c22eb0bd2de tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:37.349850 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5e6c08f3-5392-4350-9a48-9c22eb0bd2de tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:37.350700 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5e6c08f3-5392-4350-9a48-9c22eb0bd2de tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:37.351209 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5e6c08f3-5392-4350-9a48-9c22eb0bd2de tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:37.356663 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:37.459340 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-abdf1410-790d-4aad-9320-adb9916e712a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:37.466984 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-abdf1410-790d-4aad-9320-adb9916e712a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1470 microversion: 2.1 time: 0.163733 Jun 23 17:14:37.467563 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 197/395] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:37 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:37.479405 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-eaddd2c2-7a04-4719-b26b-f2889f88fa75 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:37.480004 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-eaddd2c2-7a04-4719-b26b-f2889f88fa75 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:37.486227 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-eaddd2c2-7a04-4719-b26b-f2889f88fa75 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:37.486678 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-eaddd2c2-7a04-4719-b26b-f2889f88fa75 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:37.487430 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-eaddd2c2-7a04-4719-b26b-f2889f88fa75 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:37.487857 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-eaddd2c2-7a04-4719-b26b-f2889f88fa75 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:37.488831 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5e6c08f3-5392-4350-9a48-9c22eb0bd2de tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:37.496474 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5e6c08f3-5392-4350-9a48-9c22eb0bd2de tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.159881 Jun 23 17:14:37.497126 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 199/396] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:37 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:37.618412 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-eaddd2c2-7a04-4719-b26b-f2889f88fa75 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:37.626073 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-eaddd2c2-7a04-4719-b26b-f2889f88fa75 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.150398 Jun 23 17:14:37.626611 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 198/397] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:37 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:38.486748 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-278f8066-89c0-4316-a500-2045e8c2294a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:38.487508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-278f8066-89c0-4316-a500-2045e8c2294a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:38.495882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-278f8066-89c0-4316-a500-2045e8c2294a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:38.496462 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-278f8066-89c0-4316-a500-2045e8c2294a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:38.497593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-278f8066-89c0-4316-a500-2045e8c2294a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:38.498189 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-278f8066-89c0-4316-a500-2045e8c2294a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:38.512445 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0c571e67-5ec5-44d5-aad7-1ea1d3c037c4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:38.513043 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0c571e67-5ec5-44d5-aad7-1ea1d3c037c4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:38.519930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c571e67-5ec5-44d5-aad7-1ea1d3c037c4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:38.520368 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c571e67-5ec5-44d5-aad7-1ea1d3c037c4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:38.521122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c571e67-5ec5-44d5-aad7-1ea1d3c037c4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:38.521548 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c571e67-5ec5-44d5-aad7-1ea1d3c037c4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:38.633375 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-278f8066-89c0-4316-a500-2045e8c2294a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:38.641584 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-278f8066-89c0-4316-a500-2045e8c2294a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1470 microversion: 2.1 time: 0.160342 Jun 23 17:14:38.642288 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 200/398] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:38 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:38.646900 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9439440c-e6a8-45e4-bb22-2663ff235119 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:38.647574 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9439440c-e6a8-45e4-bb22-2663ff235119 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:38.651731 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0c571e67-5ec5-44d5-aad7-1ea1d3c037c4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:38.653636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9439440c-e6a8-45e4-bb22-2663ff235119 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:38.654119 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9439440c-e6a8-45e4-bb22-2663ff235119 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:38.654890 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9439440c-e6a8-45e4-bb22-2663ff235119 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:38.655348 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9439440c-e6a8-45e4-bb22-2663ff235119 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:38.659313 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0c571e67-5ec5-44d5-aad7-1ea1d3c037c4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.150708 Jun 23 17:14:38.659879 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 199/399] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:38 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:38.784280 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9439440c-e6a8-45e4-bb22-2663ff235119 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:38.792395 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9439440c-e6a8-45e4-bb22-2663ff235119 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.149086 Jun 23 17:14:38.792942 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 201/400] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:38 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:39.663510 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f3f03c81-a20f-46e4-8421-113bd72ac30f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:39.664409 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f3f03c81-a20f-46e4-8421-113bd72ac30f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:39.674207 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f3f03c81-a20f-46e4-8421-113bd72ac30f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:39.674650 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f3f03c81-a20f-46e4-8421-113bd72ac30f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:39.675412 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f3f03c81-a20f-46e4-8421-113bd72ac30f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:39.675844 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f3f03c81-a20f-46e4-8421-113bd72ac30f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:39.676758 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a756fdb3-abd6-4977-9803-3ebc02b44bf3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:39.677406 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a756fdb3-abd6-4977-9803-3ebc02b44bf3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:39.683779 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a756fdb3-abd6-4977-9803-3ebc02b44bf3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:39.684236 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a756fdb3-abd6-4977-9803-3ebc02b44bf3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:39.684990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a756fdb3-abd6-4977-9803-3ebc02b44bf3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:39.685419 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a756fdb3-abd6-4977-9803-3ebc02b44bf3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:39.813810 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f3f03c81-a20f-46e4-8421-113bd72ac30f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:39.827611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a756fdb3-abd6-4977-9803-3ebc02b44bf3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:39.829106 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f3f03c81-a20f-46e4-8421-113bd72ac30f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1470 microversion: 2.1 time: 0.172602 Jun 23 17:14:39.830459 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 200/401] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:39 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:39.835085 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-07223e99-cb1c-419f-9e2f-e84b4bdd7dcf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:39.835544 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a756fdb3-abd6-4977-9803-3ebc02b44bf3 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.162534 Jun 23 17:14:39.835682 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-07223e99-cb1c-419f-9e2f-e84b4bdd7dcf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:39.836496 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 202/402] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:39 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:39.842155 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07223e99-cb1c-419f-9e2f-e84b4bdd7dcf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:39.842601 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07223e99-cb1c-419f-9e2f-e84b4bdd7dcf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:39.843410 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07223e99-cb1c-419f-9e2f-e84b4bdd7dcf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:39.843978 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07223e99-cb1c-419f-9e2f-e84b4bdd7dcf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:39.977864 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-07223e99-cb1c-419f-9e2f-e84b4bdd7dcf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:39.989768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-07223e99-cb1c-419f-9e2f-e84b4bdd7dcf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.157981 Jun 23 17:14:39.990701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 201/403] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:39 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:40.850458 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4c843f43-bf40-45fe-863d-51121c3ab20a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:40.852608 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4c843f43-bf40-45fe-863d-51121c3ab20a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:40.856452 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-07f9af97-b4e1-43fc-ac50-b8429a9f667d tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:40.857482 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-07f9af97-b4e1-43fc-ac50-b8429a9f667d tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:40.861741 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4c843f43-bf40-45fe-863d-51121c3ab20a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:40.862232 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4c843f43-bf40-45fe-863d-51121c3ab20a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:40.862974 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4c843f43-bf40-45fe-863d-51121c3ab20a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:40.863399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4c843f43-bf40-45fe-863d-51121c3ab20a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:40.864753 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07f9af97-b4e1-43fc-ac50-b8429a9f667d tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:40.865196 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07f9af97-b4e1-43fc-ac50-b8429a9f667d tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:40.866015 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07f9af97-b4e1-43fc-ac50-b8429a9f667d tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:40.866409 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07f9af97-b4e1-43fc-ac50-b8429a9f667d tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:40.993296 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4c843f43-bf40-45fe-863d-51121c3ab20a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:40.995405 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-07f9af97-b4e1-43fc-ac50-b8429a9f667d tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:41.001780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4c843f43-bf40-45fe-863d-51121c3ab20a tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1470 microversion: 2.1 time: 0.157958 Jun 23 17:14:41.002946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-07f9af97-b4e1-43fc-ac50-b8429a9f667d tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.153025 Jun 23 17:14:41.003504 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 202/404] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:40 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:14:41.007947 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-909d70bb-4293-4f31-8226-6328511ff199 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:41.008517 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-909d70bb-4293-4f31-8226-6328511ff199 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:41.008705 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 203/405] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:40 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:41.014840 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-909d70bb-4293-4f31-8226-6328511ff199 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:41.015686 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-909d70bb-4293-4f31-8226-6328511ff199 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:41.016450 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-909d70bb-4293-4f31-8226-6328511ff199 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:41.016876 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-909d70bb-4293-4f31-8226-6328511ff199 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:41.169103 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-909d70bb-4293-4f31-8226-6328511ff199 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:41.177677 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-909d70bb-4293-4f31-8226-6328511ff199 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.173206 Jun 23 17:14:41.178252 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 203/406] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:41 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:42.023542 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-043005d3-3526-4643-9f54-abad0d98ef81 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:42.024452 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d857b978-2756-4de3-bb47-808d943832bf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:42.025076 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-043005d3-3526-4643-9f54-abad0d98ef81 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:42.025242 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d857b978-2756-4de3-bb47-808d943832bf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:42.033543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-043005d3-3526-4643-9f54-abad0d98ef81 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:42.034017 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-043005d3-3526-4643-9f54-abad0d98ef81 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:42.034259 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d857b978-2756-4de3-bb47-808d943832bf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:42.034667 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d857b978-2756-4de3-bb47-808d943832bf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:42.034803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-043005d3-3526-4643-9f54-abad0d98ef81 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:42.035178 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-043005d3-3526-4643-9f54-abad0d98ef81 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:42.035425 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d857b978-2756-4de3-bb47-808d943832bf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:42.035830 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d857b978-2756-4de3-bb47-808d943832bf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:42.171173 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d857b978-2756-4de3-bb47-808d943832bf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:42.174606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-043005d3-3526-4643-9f54-abad0d98ef81 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:42.179783 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d857b978-2756-4de3-bb47-808d943832bf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.162766 Jun 23 17:14:42.180578 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 204/407] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:42 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:42.182109 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-043005d3-3526-4643-9f54-abad0d98ef81 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1470 microversion: 2.1 time: 0.166039 Jun 23 17:14:42.192363 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 204/408] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:42 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:42.196460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b866bc6e-faff-4a7d-ac1b-1009674c5c17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:42.197172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b866bc6e-faff-4a7d-ac1b-1009674c5c17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:42.203947 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b866bc6e-faff-4a7d-ac1b-1009674c5c17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:42.204386 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b866bc6e-faff-4a7d-ac1b-1009674c5c17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:42.205149 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b866bc6e-faff-4a7d-ac1b-1009674c5c17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:42.205580 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b866bc6e-faff-4a7d-ac1b-1009674c5c17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:42.255947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-10895b08-4065-4eb9-a9d0-e4f3361e96f0 req-ea69b779-2ac7-41bd-aea9-b61f11617ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf401eb3-6a14-41c2-bdda-e9a448beba4f", "name": "network-vif-unplugged", "status": "completed", "tag": "4e4bcb4f-d0ad-4995-bf5c-058c872cd9af"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:14:42.271146 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-10895b08-4065-4eb9-a9d0-e4f3361e96f0 req-ea69b779-2ac7-41bd-aea9-b61f11617ec7 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:42.271582 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-10895b08-4065-4eb9-a9d0-e4f3361e96f0 req-ea69b779-2ac7-41bd-aea9-b61f11617ec7 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:42.295854 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-10895b08-4065-4eb9-a9d0-e4f3361e96f0 req-ea69b779-2ac7-41bd-aea9-b61f11617ec7 service nova] Creating event network-vif-unplugged:4e4bcb4f-d0ad-4995-bf5c-058c872cd9af for instance bf401eb3-6a14-41c2-bdda-e9a448beba4f on hv-cinder-83538 Jun 23 17:14:42.301755 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-10895b08-4065-4eb9-a9d0-e4f3361e96f0 req-ea69b779-2ac7-41bd-aea9-b61f11617ec7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058082 Jun 23 17:14:42.312430 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 205/409] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:14:42.349980 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b866bc6e-faff-4a7d-ac1b-1009674c5c17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:42.358177 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b866bc6e-faff-4a7d-ac1b-1009674c5c17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.166691 Jun 23 17:14:42.358824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 205/410] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:42 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:43.199717 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-34830c46-c29c-4673-8ba9-d5ef81fcd11f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:43.200371 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5ea791d3-78b6-4868-a5a2-3f462b55281f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:43.200796 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-34830c46-c29c-4673-8ba9-d5ef81fcd11f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:43.200928 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5ea791d3-78b6-4868-a5a2-3f462b55281f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:43.207733 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5ea791d3-78b6-4868-a5a2-3f462b55281f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:43.207897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-34830c46-c29c-4673-8ba9-d5ef81fcd11f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:43.208103 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-34830c46-c29c-4673-8ba9-d5ef81fcd11f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:43.208223 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5ea791d3-78b6-4868-a5a2-3f462b55281f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:43.208860 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-34830c46-c29c-4673-8ba9-d5ef81fcd11f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:43.208981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5ea791d3-78b6-4868-a5a2-3f462b55281f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:43.209287 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5ea791d3-78b6-4868-a5a2-3f462b55281f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:43.209408 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-34830c46-c29c-4673-8ba9-d5ef81fcd11f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:43.346849 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-34830c46-c29c-4673-8ba9-d5ef81fcd11f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:43.347024 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5ea791d3-78b6-4868-a5a2-3f462b55281f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:43.355034 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5ea791d3-78b6-4868-a5a2-3f462b55281f tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1470 microversion: 2.1 time: 0.159210 Jun 23 17:14:43.355625 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 206/411] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:43 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:43.360422 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-34830c46-c29c-4673-8ba9-d5ef81fcd11f tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1313 microversion: 2.1 time: 0.165417 Jun 23 17:14:43.361067 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 206/412] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:43 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:43.378558 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-71ee921a-565c-4021-add3-e895b5c703e2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:43.379158 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-71ee921a-565c-4021-add3-e895b5c703e2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:43.385307 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-71ee921a-565c-4021-add3-e895b5c703e2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:43.385733 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-71ee921a-565c-4021-add3-e895b5c703e2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:43.386531 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-71ee921a-565c-4021-add3-e895b5c703e2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:43.386973 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-71ee921a-565c-4021-add3-e895b5c703e2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:43.519276 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-71ee921a-565c-4021-add3-e895b5c703e2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:43.528318 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-71ee921a-565c-4021-add3-e895b5c703e2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.154188 Jun 23 17:14:43.528975 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 207/413] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:43 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:44.281400 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-88b8581a-d461-44c2-8e92-a8b9f75d42b3 req-5dbc0a27-269b-47b2-b0b9-1591825e9208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf401eb3-6a14-41c2-bdda-e9a448beba4f", "name": "network-vif-deleted", "tag": "4e4bcb4f-d0ad-4995-bf5c-058c872cd9af"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:14:44.291810 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-88b8581a-d461-44c2-8e92-a8b9f75d42b3 req-5dbc0a27-269b-47b2-b0b9-1591825e9208 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:44.292462 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-88b8581a-d461-44c2-8e92-a8b9f75d42b3 req-5dbc0a27-269b-47b2-b0b9-1591825e9208 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:44.309282 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-88b8581a-d461-44c2-8e92-a8b9f75d42b3 req-5dbc0a27-269b-47b2-b0b9-1591825e9208 service nova] Creating event network-vif-deleted:4e4bcb4f-d0ad-4995-bf5c-058c872cd9af for instance bf401eb3-6a14-41c2-bdda-e9a448beba4f on hv-cinder-83538 Jun 23 17:14:44.317744 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-88b8581a-d461-44c2-8e92-a8b9f75d42b3 req-5dbc0a27-269b-47b2-b0b9-1591825e9208 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040114 Jun 23 17:14:44.318678 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 207/414] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:14:44.373983 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ac9c6b09-bcf8-48d9-8946-f75ba18fee66 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:44.374591 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ac9c6b09-bcf8-48d9-8946-f75ba18fee66 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:44.377883 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6e420a08-a7b1-49cd-9b4f-ed1adfa5d8f4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:44.378874 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6e420a08-a7b1-49cd-9b4f-ed1adfa5d8f4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:44.382685 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ac9c6b09-bcf8-48d9-8946-f75ba18fee66 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:44.386267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ac9c6b09-bcf8-48d9-8946-f75ba18fee66 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:44.387147 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ac9c6b09-bcf8-48d9-8946-f75ba18fee66 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:44.387586 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ac9c6b09-bcf8-48d9-8946-f75ba18fee66 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:44.388697 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e420a08-a7b1-49cd-9b4f-ed1adfa5d8f4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:44.390062 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e420a08-a7b1-49cd-9b4f-ed1adfa5d8f4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:44.391290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e420a08-a7b1-49cd-9b4f-ed1adfa5d8f4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:44.392102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e420a08-a7b1-49cd-9b4f-ed1adfa5d8f4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:44.465965 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ac9c6b09-bcf8-48d9-8946-f75ba18fee66 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:44.474956 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ac9c6b09-bcf8-48d9-8946-f75ba18fee66 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1428 microversion: 2.1 time: 0.106008 Jun 23 17:14:44.475369 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 208/415] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:44 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1428 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:44.546114 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bfcd4366-c5d4-454f-bdbf-a230bcdb0f05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:44.546716 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bfcd4366-c5d4-454f-bdbf-a230bcdb0f05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:44.554779 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bfcd4366-c5d4-454f-bdbf-a230bcdb0f05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:44.555308 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bfcd4366-c5d4-454f-bdbf-a230bcdb0f05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:44.556227 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bfcd4366-c5d4-454f-bdbf-a230bcdb0f05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:44.556738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bfcd4366-c5d4-454f-bdbf-a230bcdb0f05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:44.567866 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6e420a08-a7b1-49cd-9b4f-ed1adfa5d8f4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:44.577093 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6e420a08-a7b1-49cd-9b4f-ed1adfa5d8f4 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1497 microversion: 2.1 time: 0.203980 Jun 23 17:14:44.577966 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 208/416] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:44 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:44.728994 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bfcd4366-c5d4-454f-bdbf-a230bcdb0f05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:44.736773 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bfcd4366-c5d4-454f-bdbf-a230bcdb0f05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.194973 Jun 23 17:14:44.737370 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 209/417] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:44 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:45.498250 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f89afd7c-5b2e-41c5-9b98-dda4e21c7076 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:45.499244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f89afd7c-5b2e-41c5-9b98-dda4e21c7076 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:45.509457 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f89afd7c-5b2e-41c5-9b98-dda4e21c7076 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:45.510291 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f89afd7c-5b2e-41c5-9b98-dda4e21c7076 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:45.511533 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f89afd7c-5b2e-41c5-9b98-dda4e21c7076 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:45.512238 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f89afd7c-5b2e-41c5-9b98-dda4e21c7076 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:45.583134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f89afd7c-5b2e-41c5-9b98-dda4e21c7076 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:45.593218 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f89afd7c-5b2e-41c5-9b98-dda4e21c7076 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1428 microversion: 2.1 time: 0.101466 Jun 23 17:14:45.594477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 209/418] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:45 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:45.754691 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1f83306c-2450-4fd9-8203-e5b015fc0054 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:45.755294 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1f83306c-2450-4fd9-8203-e5b015fc0054 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:45.762189 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f83306c-2450-4fd9-8203-e5b015fc0054 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:45.762671 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f83306c-2450-4fd9-8203-e5b015fc0054 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:45.763363 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f83306c-2450-4fd9-8203-e5b015fc0054 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:45.763799 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f83306c-2450-4fd9-8203-e5b015fc0054 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:45.894349 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1f83306c-2450-4fd9-8203-e5b015fc0054 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:45.897839 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:45.902321 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1f83306c-2450-4fd9-8203-e5b015fc0054 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.152143 Jun 23 17:14:45.902863 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 210/419] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:45 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:46.615492 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-26d828dd-18c1-4a47-a7e5-161afd698088 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:46.616496 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-26d828dd-18c1-4a47-a7e5-161afd698088 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:46.627119 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-26d828dd-18c1-4a47-a7e5-161afd698088 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:46.627572 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-26d828dd-18c1-4a47-a7e5-161afd698088 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:46.628339 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-26d828dd-18c1-4a47-a7e5-161afd698088 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:46.628776 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-26d828dd-18c1-4a47-a7e5-161afd698088 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:46.693016 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-26d828dd-18c1-4a47-a7e5-161afd698088 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:46.702803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-26d828dd-18c1-4a47-a7e5-161afd698088 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1428 microversion: 2.1 time: 0.094682 Jun 23 17:14:46.703892 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 210/420] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:46 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:46.921840 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b3a271b0-13a9-43ae-8deb-cbb41169dd40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:46.922506 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b3a271b0-13a9-43ae-8deb-cbb41169dd40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:46.932573 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3a271b0-13a9-43ae-8deb-cbb41169dd40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:46.933025 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3a271b0-13a9-43ae-8deb-cbb41169dd40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:46.933809 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3a271b0-13a9-43ae-8deb-cbb41169dd40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:46.934256 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3a271b0-13a9-43ae-8deb-cbb41169dd40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:47.081201 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b3a271b0-13a9-43ae-8deb-cbb41169dd40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:47.089360 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b3a271b0-13a9-43ae-8deb-cbb41169dd40 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.172993 Jun 23 17:14:47.089981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 211/421] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:46 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:47.720305 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-119acc44-cff5-49d0-968d-957743d2b785 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:47.720906 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-119acc44-cff5-49d0-968d-957743d2b785 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:47.727170 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-119acc44-cff5-49d0-968d-957743d2b785 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:47.727624 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-119acc44-cff5-49d0-968d-957743d2b785 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:47.728374 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-119acc44-cff5-49d0-968d-957743d2b785 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:47.728805 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-119acc44-cff5-49d0-968d-957743d2b785 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:47.794806 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-119acc44-cff5-49d0-968d-957743d2b785 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:47.803084 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-119acc44-cff5-49d0-968d-957743d2b785 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1428 microversion: 2.1 time: 0.086877 Jun 23 17:14:47.803651 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 211/422] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:47 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:48.107293 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ef921166-d41a-4cca-8759-763cd5e40266 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:48.107994 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ef921166-d41a-4cca-8759-763cd5e40266 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:48.115682 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef921166-d41a-4cca-8759-763cd5e40266 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:48.116296 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef921166-d41a-4cca-8759-763cd5e40266 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:48.117443 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef921166-d41a-4cca-8759-763cd5e40266 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:48.118032 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef921166-d41a-4cca-8759-763cd5e40266 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:48.287781 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ef921166-d41a-4cca-8759-763cd5e40266 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:48.297273 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ef921166-d41a-4cca-8759-763cd5e40266 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.194029 Jun 23 17:14:48.298190 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 212/423] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:48 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:48.824313 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3fbc1c40-41be-4812-9e33-614f1f5589c2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:48.824886 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3fbc1c40-41be-4812-9e33-614f1f5589c2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:48.834561 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3fbc1c40-41be-4812-9e33-614f1f5589c2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:48.835011 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3fbc1c40-41be-4812-9e33-614f1f5589c2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:48.835780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3fbc1c40-41be-4812-9e33-614f1f5589c2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:48.836210 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3fbc1c40-41be-4812-9e33-614f1f5589c2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:48.905539 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3fbc1c40-41be-4812-9e33-614f1f5589c2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:48.920518 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3fbc1c40-41be-4812-9e33-614f1f5589c2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1428 microversion: 2.1 time: 0.100048 Jun 23 17:14:48.921664 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 212/424] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:48 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1428 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:49.328850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f2131df5-c7de-46ff-aab8-bd90be9ccdef tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:49.329456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f2131df5-c7de-46ff-aab8-bd90be9ccdef tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:49.336750 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2131df5-c7de-46ff-aab8-bd90be9ccdef tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:49.337168 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2131df5-c7de-46ff-aab8-bd90be9ccdef tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:49.338031 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2131df5-c7de-46ff-aab8-bd90be9ccdef tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:49.338460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2131df5-c7de-46ff-aab8-bd90be9ccdef tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:49.475504 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f2131df5-c7de-46ff-aab8-bd90be9ccdef tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:49.483463 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f2131df5-c7de-46ff-aab8-bd90be9ccdef tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1522 microversion: 2.1 time: 0.160884 Jun 23 17:14:49.484028 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 213/425] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:49 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:49.939388 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-20b8ece4-bc64-4ddf-8393-482607ddc0e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:49.940189 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-20b8ece4-bc64-4ddf-8393-482607ddc0e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:49.947721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-20b8ece4-bc64-4ddf-8393-482607ddc0e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:49.948323 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-20b8ece4-bc64-4ddf-8393-482607ddc0e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:49.949241 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-20b8ece4-bc64-4ddf-8393-482607ddc0e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:49.950341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-20b8ece4-bc64-4ddf-8393-482607ddc0e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:50.000176 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-20b8ece4-bc64-4ddf-8393-482607ddc0e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:50.000941 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-20b8ece4-bc64-4ddf-8393-482607ddc0e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:50.001544 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-20b8ece4-bc64-4ddf-8393-482607ddc0e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lazy-loading 'fault' on Instance uuid bf401eb3-6a14-41c2-bdda-e9a448beba4f {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:14:50.049496 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-20b8ece4-bc64-4ddf-8393-482607ddc0e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:50.060333 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-20b8ece4-bc64-4ddf-8393-482607ddc0e2 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1304 microversion: 2.1 time: 0.126058 Jun 23 17:14:50.069828 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 213/426] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:49 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:50.500479 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e19117fb-d7f7-4118-98d9-c236eeffc504 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:50.501126 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e19117fb-d7f7-4118-98d9-c236eeffc504 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:50.508137 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e19117fb-d7f7-4118-98d9-c236eeffc504 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:50.508586 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e19117fb-d7f7-4118-98d9-c236eeffc504 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:50.509343 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e19117fb-d7f7-4118-98d9-c236eeffc504 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:50.509773 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e19117fb-d7f7-4118-98d9-c236eeffc504 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:50.658274 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e19117fb-d7f7-4118-98d9-c236eeffc504 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:50.670449 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e19117fb-d7f7-4118-98d9-c236eeffc504 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1502 microversion: 2.1 time: 0.173566 Jun 23 17:14:50.670786 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 214/427] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:50 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:50.693427 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3779f519-3dbf-4a10-9cca-bbd30163d030 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:50.694737 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3779f519-3dbf-4a10-9cca-bbd30163d030 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:50.701722 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3779f519-3dbf-4a10-9cca-bbd30163d030 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:50.702269 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3779f519-3dbf-4a10-9cca-bbd30163d030 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:50.703440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3779f519-3dbf-4a10-9cca-bbd30163d030 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:50.703647 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3779f519-3dbf-4a10-9cca-bbd30163d030 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:50.718650 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8b91df75-4c6d-418d-87a3-de38a9028864 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:50.719130 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8b91df75-4c6d-418d-87a3-de38a9028864 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:50.725728 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8b91df75-4c6d-418d-87a3-de38a9028864 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:50.726203 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8b91df75-4c6d-418d-87a3-de38a9028864 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:50.726961 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8b91df75-4c6d-418d-87a3-de38a9028864 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:50.727391 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8b91df75-4c6d-418d-87a3-de38a9028864 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:50.755609 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8b91df75-4c6d-418d-87a3-de38a9028864 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:14:50.838181 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8b91df75-4c6d-418d-87a3-de38a9028864 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 204 len: 0 microversion: 2.1 time: 0.123097 Jun 23 17:14:50.838770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 215/428] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:14:50 2022] DELETE /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 17:14:50.847239 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0ec6b07c-4467-4f02-9f74-e595ccae3dd1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:50.847936 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0ec6b07c-4467-4f02-9f74-e595ccae3dd1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:50.849113 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3779f519-3dbf-4a10-9cca-bbd30163d030 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:50.854406 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ec6b07c-4467-4f02-9f74-e595ccae3dd1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:50.854855 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ec6b07c-4467-4f02-9f74-e595ccae3dd1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:50.855662 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ec6b07c-4467-4f02-9f74-e595ccae3dd1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:50.856111 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ec6b07c-4467-4f02-9f74-e595ccae3dd1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:50.859412 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3779f519-3dbf-4a10-9cca-bbd30163d030 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1517 microversion: 2.1 time: 0.170055 Jun 23 17:14:50.870186 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 214/429] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:50 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:51.005455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0ec6b07c-4467-4f02-9f74-e595ccae3dd1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:51.014244 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0ec6b07c-4467-4f02-9f74-e595ccae3dd1 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1503 microversion: 2.1 time: 0.171026 Jun 23 17:14:51.015014 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 216/430] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:50 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:14:51.085248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a032df2d-0fed-4fc0-acdb-8033eaf6ef90 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:51.086048 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a032df2d-0fed-4fc0-acdb-8033eaf6ef90 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:51.092461 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a032df2d-0fed-4fc0-acdb-8033eaf6ef90 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:51.092933 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a032df2d-0fed-4fc0-acdb-8033eaf6ef90 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:51.093695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a032df2d-0fed-4fc0-acdb-8033eaf6ef90 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:51.100382 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a032df2d-0fed-4fc0-acdb-8033eaf6ef90 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:51.130517 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a032df2d-0fed-4fc0-acdb-8033eaf6ef90 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:51.130974 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a032df2d-0fed-4fc0-acdb-8033eaf6ef90 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:51.131418 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-a032df2d-0fed-4fc0-acdb-8033eaf6ef90 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lazy-loading 'fault' on Instance uuid bf401eb3-6a14-41c2-bdda-e9a448beba4f {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:14:51.190396 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a032df2d-0fed-4fc0-acdb-8033eaf6ef90 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:51.198789 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a032df2d-0fed-4fc0-acdb-8033eaf6ef90 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1304 microversion: 2.1 time: 0.118108 Jun 23 17:14:51.208707 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 215/431] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:51 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:52.032714 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d5067781-b807-4d18-b78b-7df6ff82bc07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:52.033419 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d5067781-b807-4d18-b78b-7df6ff82bc07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:52.043149 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5067781-b807-4d18-b78b-7df6ff82bc07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:52.043949 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5067781-b807-4d18-b78b-7df6ff82bc07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:52.044330 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5067781-b807-4d18-b78b-7df6ff82bc07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:52.044938 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5067781-b807-4d18-b78b-7df6ff82bc07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:52.217908 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d5067781-b807-4d18-b78b-7df6ff82bc07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:52.222593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-231d618e-ae9d-4218-b453-39be99ffd476 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:52.224342 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-231d618e-ae9d-4218-b453-39be99ffd476 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:52.228150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d5067781-b807-4d18-b78b-7df6ff82bc07 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1503 microversion: 2.1 time: 0.199448 Jun 23 17:14:52.228918 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 217/432] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:52 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:52.230807 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-231d618e-ae9d-4218-b453-39be99ffd476 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:52.231239 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-231d618e-ae9d-4218-b453-39be99ffd476 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:52.232146 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-231d618e-ae9d-4218-b453-39be99ffd476 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:52.232576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-231d618e-ae9d-4218-b453-39be99ffd476 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:52.252159 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:52.277050 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-231d618e-ae9d-4218-b453-39be99ffd476 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:52.277619 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-231d618e-ae9d-4218-b453-39be99ffd476 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:52.278189 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-231d618e-ae9d-4218-b453-39be99ffd476 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lazy-loading 'fault' on Instance uuid bf401eb3-6a14-41c2-bdda-e9a448beba4f {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:14:52.323787 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-231d618e-ae9d-4218-b453-39be99ffd476 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5064e0f807490ab7f83657ff51a09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c8d1e8f35e461dbdc25783106e4a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:52.331662 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-231d618e-ae9d-4218-b453-39be99ffd476 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 200 len: 1304 microversion: 2.1 time: 0.114557 Jun 23 17:14:52.333043 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 216/433] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:52 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:53.244882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d45dd57f-16d1-4285-b8f4-c1eceb1b1ecf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:53.245657 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d45dd57f-16d1-4285-b8f4-c1eceb1b1ecf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:53.252541 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d45dd57f-16d1-4285-b8f4-c1eceb1b1ecf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:53.252986 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d45dd57f-16d1-4285-b8f4-c1eceb1b1ecf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:53.253748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d45dd57f-16d1-4285-b8f4-c1eceb1b1ecf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:53.254283 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d45dd57f-16d1-4285-b8f4-c1eceb1b1ecf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:53.349714 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9069b0b1-393c-4a5b-923b-33365eebe332 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:53.351723 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9069b0b1-393c-4a5b-923b-33365eebe332 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] [instance: bf401eb3-6a14-41c2-bdda-e9a448beba4f] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:53.371803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9069b0b1-393c-4a5b-923b-33365eebe332 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:53.372739 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9069b0b1-393c-4a5b-923b-33365eebe332 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:53.373516 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9069b0b1-393c-4a5b-923b-33365eebe332 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:53.373985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9069b0b1-393c-4a5b-923b-33365eebe332 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:53.389080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-9069b0b1-393c-4a5b-923b-33365eebe332 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] HTTP exception thrown: Instance bf401eb3-6a14-41c2-bdda-e9a448beba4f could not be found. Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9069b0b1-393c-4a5b-923b-33365eebe332 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Request method failure captured: Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f HTTP/1.1 Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ9GmySYryCRA7iqane0R7jaLylVLXzXf7vsgj9cpewExSW2y0_CZrfIdBSPgKGUOqdAFT7Ga_Q4_CR806tmVYv6kHhOarjYihpnn632BN-jbNav5NSs2v8QmI1Up7J82yRaoIVpMTw5kGMH9KbZEiX-OVqm78V651z3tICfraXZmww Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 99c8d1e8f35e461dbdc25783106e4a44 Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-VolumesNegativeTest-1127788885 Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:14:53.391450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:14:53.393022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/99c8d1e8f35e461dbdc25783106e4a44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/99c8d1e8f35e461dbdc25783106e4a44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_99c8d1e8f35e461dbdc25783106e4a44", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/99c8d1e8f35e461dbdc25783106e4a44"}]}] Jun 23 17:14:53.393022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-VolumesNegativeTest-1127788885 Jun 23 17:14:53.393022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 99c8d1e8f35e461dbdc25783106e4a44 Jun 23 17:14:53.393022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-VolumesNegativeTest-1127788885 Jun 23 17:14:53.393022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-VolumesNegativeTest-1127788885-project Jun 23 17:14:53.393022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:14:53.393022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:14:53.393022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 4d5064e0f807490ab7f83657ff51a09f Jun 23 17:14:53.393022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-VolumesNegativeTest-1127788885-project Jun 23 17:14:53.393022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:14:53.393022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance bf401eb3-6a14-41c2-bdda-e9a448beba4f could not be found. Jun 23 17:14:53.393022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': 'bf401eb3-6a14-41c2-bdda-e9a448beba4f'} Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf401eb3-6a14-41c2-bdda-e9a448beba4f could not be found. Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:14:53.394074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf401eb3-6a14-41c2-bdda-e9a448beba4f could not be found. Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf401eb3-6a14-41c2-bdda-e9a448beba4f could not be found. Jun 23 17:14:53.395552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:14:53.397491 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9069b0b1-393c-4a5b-923b-33365eebe332 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] Returning 404 to user: Instance bf401eb3-6a14-41c2-bdda-e9a448beba4f could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:14:53.398495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9069b0b1-393c-4a5b-923b-33365eebe332 tempest-VolumesNegativeTest-1127788885 tempest-VolumesNegativeTest-1127788885-project] 10.222.0.18 "GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f" status: 404 len: 111 microversion: 2.1 time: 0.053959 Jun 23 17:14:53.399522 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 217/434] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:53 2022] GET /compute/v2.1/servers/bf401eb3-6a14-41c2-bdda-e9a448beba4f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 17:14:53.402574 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d45dd57f-16d1-4285-b8f4-c1eceb1b1ecf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:53.405351 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-de22380c-64ca-4175-adbf-7a4dc2d6eaba tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:14:53.414890 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-de22380c-64ca-4175-adbf-7a4dc2d6eaba tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:53.417085 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d45dd57f-16d1-4285-b8f4-c1eceb1b1ecf tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1503 microversion: 2.1 time: 0.175507 Jun 23 17:14:53.418041 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 218/435] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:53 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:53.422437 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-de22380c-64ca-4175-adbf-7a4dc2d6eaba tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:53.422999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-de22380c-64ca-4175-adbf-7a4dc2d6eaba tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:53.423993 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-de22380c-64ca-4175-adbf-7a4dc2d6eaba tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:53.424543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-de22380c-64ca-4175-adbf-7a4dc2d6eaba tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:53.449060 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-de22380c-64ca-4175-adbf-7a4dc2d6eaba tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lazy-loading 'flavor' on Instance uuid 517df8d9-1e33-4448-a439-8ea166866a32 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:14:53.567939 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-de22380c-64ca-4175-adbf-7a4dc2d6eaba tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "POST /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32/action" status: 200 len: 32 microversion: 2.1 time: 0.166126 Jun 23 17:14:53.568564 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 218/436] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 23 17:14:53 2022] POST /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 17:14:53.577760 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f4c05c8d-947a-408c-a8b8-3ededa67a39c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:53.578476 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f4c05c8d-947a-408c-a8b8-3ededa67a39c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:53.584712 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f4c05c8d-947a-408c-a8b8-3ededa67a39c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:53.585262 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f4c05c8d-947a-408c-a8b8-3ededa67a39c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:53.586134 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f4c05c8d-947a-408c-a8b8-3ededa67a39c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:53.586644 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f4c05c8d-947a-408c-a8b8-3ededa67a39c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:53.719199 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f4c05c8d-947a-408c-a8b8-3ededa67a39c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:53.727259 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f4c05c8d-947a-408c-a8b8-3ededa67a39c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.153348 Jun 23 17:14:53.727836 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 219/437] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:53 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:54.436327 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d701dd0f-a2fd-4f11-ae13-8d490c17d688 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:54.437884 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d701dd0f-a2fd-4f11-ae13-8d490c17d688 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:54.444846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d701dd0f-a2fd-4f11-ae13-8d490c17d688 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:54.445486 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d701dd0f-a2fd-4f11-ae13-8d490c17d688 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:54.446322 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d701dd0f-a2fd-4f11-ae13-8d490c17d688 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:54.449683 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d701dd0f-a2fd-4f11-ae13-8d490c17d688 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:54.597994 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d701dd0f-a2fd-4f11-ae13-8d490c17d688 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:54.605750 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d701dd0f-a2fd-4f11-ae13-8d490c17d688 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1503 microversion: 2.1 time: 0.174379 Jun 23 17:14:54.606345 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 219/438] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:54 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:54.747592 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f68624c1-83bc-483e-a7a9-54eaaee2187a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:54.748193 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f68624c1-83bc-483e-a7a9-54eaaee2187a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:54.755164 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f68624c1-83bc-483e-a7a9-54eaaee2187a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:54.755605 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f68624c1-83bc-483e-a7a9-54eaaee2187a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:54.756364 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f68624c1-83bc-483e-a7a9-54eaaee2187a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:54.756785 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f68624c1-83bc-483e-a7a9-54eaaee2187a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:54.903235 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f68624c1-83bc-483e-a7a9-54eaaee2187a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:54.911240 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f68624c1-83bc-483e-a7a9-54eaaee2187a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.167340 Jun 23 17:14:54.911961 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 220/439] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:54 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:55.623485 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-82e400d1-8b46-4975-ada9-0a28884120ac tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:55.623960 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-82e400d1-8b46-4975-ada9-0a28884120ac tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:55.630802 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-82e400d1-8b46-4975-ada9-0a28884120ac tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:55.631250 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-82e400d1-8b46-4975-ada9-0a28884120ac tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:55.632018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-82e400d1-8b46-4975-ada9-0a28884120ac tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:55.632455 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-82e400d1-8b46-4975-ada9-0a28884120ac tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:55.767729 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-82e400d1-8b46-4975-ada9-0a28884120ac tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:55.776085 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-82e400d1-8b46-4975-ada9-0a28884120ac tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1503 microversion: 2.1 time: 0.156514 Jun 23 17:14:55.776651 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 220/440] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:55 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:55.928941 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-938ddabe-4bf0-4a8b-aeb0-e4238dd56f04 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:55.929642 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-938ddabe-4bf0-4a8b-aeb0-e4238dd56f04 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:55.937428 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-938ddabe-4bf0-4a8b-aeb0-e4238dd56f04 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:55.937754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-938ddabe-4bf0-4a8b-aeb0-e4238dd56f04 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:55.938559 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-938ddabe-4bf0-4a8b-aeb0-e4238dd56f04 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:55.938991 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-938ddabe-4bf0-4a8b-aeb0-e4238dd56f04 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:56.086114 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-938ddabe-4bf0-4a8b-aeb0-e4238dd56f04 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:56.094829 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-938ddabe-4bf0-4a8b-aeb0-e4238dd56f04 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.170142 Jun 23 17:14:56.095366 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 221/441] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:55 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:56.795471 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6f21dbcf-2e73-4540-b060-9e8dc9e32e0a tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:56.797689 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6f21dbcf-2e73-4540-b060-9e8dc9e32e0a tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:56.802759 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6f21dbcf-2e73-4540-b060-9e8dc9e32e0a tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:56.803210 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6f21dbcf-2e73-4540-b060-9e8dc9e32e0a tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:56.803972 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6f21dbcf-2e73-4540-b060-9e8dc9e32e0a tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:56.804448 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6f21dbcf-2e73-4540-b060-9e8dc9e32e0a tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:56.940064 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6f21dbcf-2e73-4540-b060-9e8dc9e32e0a tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:56.947949 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6f21dbcf-2e73-4540-b060-9e8dc9e32e0a tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1503 microversion: 2.1 time: 0.156493 Jun 23 17:14:56.948483 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 221/442] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:56 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:57.115928 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c5bb15b0-4bb4-4363-be12-c57cfbd6747c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:57.116843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c5bb15b0-4bb4-4363-be12-c57cfbd6747c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:57.127910 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c5bb15b0-4bb4-4363-be12-c57cfbd6747c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:57.128644 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c5bb15b0-4bb4-4363-be12-c57cfbd6747c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:57.129916 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c5bb15b0-4bb4-4363-be12-c57cfbd6747c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:57.130470 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c5bb15b0-4bb4-4363-be12-c57cfbd6747c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:57.270012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c5bb15b0-4bb4-4363-be12-c57cfbd6747c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:57.278085 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c5bb15b0-4bb4-4363-be12-c57cfbd6747c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.168590 Jun 23 17:14:57.278635 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 222/443] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:57 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:57.972764 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-126f2a3c-45b5-49a3-9882-76636c34b9b6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:57.973400 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-126f2a3c-45b5-49a3-9882-76636c34b9b6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:57.980075 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-126f2a3c-45b5-49a3-9882-76636c34b9b6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:57.980593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-126f2a3c-45b5-49a3-9882-76636c34b9b6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:57.981427 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-126f2a3c-45b5-49a3-9882-76636c34b9b6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:57.981964 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-126f2a3c-45b5-49a3-9882-76636c34b9b6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:58.117285 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-126f2a3c-45b5-49a3-9882-76636c34b9b6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:58.125666 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-126f2a3c-45b5-49a3-9882-76636c34b9b6 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1503 microversion: 2.1 time: 0.156846 Jun 23 17:14:58.126315 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 222/444] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:57 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:58.295721 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-11de5fa9-60e6-4892-a2d2-9893e2a09068 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:58.296462 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-11de5fa9-60e6-4892-a2d2-9893e2a09068 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:58.304893 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-11de5fa9-60e6-4892-a2d2-9893e2a09068 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:58.305332 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-11de5fa9-60e6-4892-a2d2-9893e2a09068 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:58.306430 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-11de5fa9-60e6-4892-a2d2-9893e2a09068 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:58.306954 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-11de5fa9-60e6-4892-a2d2-9893e2a09068 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:58.744852 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-fda80117-520a-471d-8bd5-53c28bc2da04 req-7fecba6a-c59a-4090-b6b1-506e27dc99a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7546dd4f-e528-4cbe-914c-a1f008219334", "name": "network-vif-deleted", "tag": "4d534458-e5c6-486b-b395-5ee1cf6a3416"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:14:58.754480 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-fda80117-520a-471d-8bd5-53c28bc2da04 req-7fecba6a-c59a-4090-b6b1-506e27dc99a2 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:58.755636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-fda80117-520a-471d-8bd5-53c28bc2da04 req-7fecba6a-c59a-4090-b6b1-506e27dc99a2 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:58.770162 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-fda80117-520a-471d-8bd5-53c28bc2da04 req-7fecba6a-c59a-4090-b6b1-506e27dc99a2 service nova] Creating event network-vif-deleted:4d534458-e5c6-486b-b395-5ee1cf6a3416 for instance 7546dd4f-e528-4cbe-914c-a1f008219334 on hv-cinder-83538 Jun 23 17:14:58.780185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-fda80117-520a-471d-8bd5-53c28bc2da04 req-7fecba6a-c59a-4090-b6b1-506e27dc99a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038890 Jun 23 17:14:58.782365 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 223/445] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:14:58.824369 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-11de5fa9-60e6-4892-a2d2-9893e2a09068 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:58.834234 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-11de5fa9-60e6-4892-a2d2-9893e2a09068 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.542783 Jun 23 17:14:58.834829 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 223/446] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:58 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:59.145740 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d57c9f03-173b-4d25-9796-552d6389da20 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:59.146673 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d57c9f03-173b-4d25-9796-552d6389da20 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:59.153312 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d57c9f03-173b-4d25-9796-552d6389da20 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:59.153736 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d57c9f03-173b-4d25-9796-552d6389da20 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:59.154518 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d57c9f03-173b-4d25-9796-552d6389da20 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:59.154944 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d57c9f03-173b-4d25-9796-552d6389da20 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:59.188679 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d57c9f03-173b-4d25-9796-552d6389da20 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:59.189021 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d57c9f03-173b-4d25-9796-552d6389da20 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:59.189634 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-d57c9f03-173b-4d25-9796-552d6389da20 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lazy-loading 'fault' on Instance uuid 7546dd4f-e528-4cbe-914c-a1f008219334 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:14:59.233820 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d57c9f03-173b-4d25-9796-552d6389da20 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d1af25b199404b9f432b21c825b447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa636b31dd844b93b83300a3de1418ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:14:59.241689 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d57c9f03-173b-4d25-9796-552d6389da20 tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 200 len: 1303 microversion: 2.1 time: 0.100944 Jun 23 17:14:59.242290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 224/447] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:59 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:14:59.852429 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8e063589-17ef-431c-b12e-ff14c0053470 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:14:59.853939 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8e063589-17ef-431c-b12e-ff14c0053470 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:14:59.862747 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e063589-17ef-431c-b12e-ff14c0053470 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:59.863195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e063589-17ef-431c-b12e-ff14c0053470 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:14:59.864433 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e063589-17ef-431c-b12e-ff14c0053470 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:14:59.865067 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e063589-17ef-431c-b12e-ff14c0053470 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:00.039062 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8e063589-17ef-431c-b12e-ff14c0053470 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:00.049221 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8e063589-17ef-431c-b12e-ff14c0053470 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.200986 Jun 23 17:15:00.056013 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 224/448] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:14:59 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:00.261190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ebb660e2-42b1-43d4-a5b2-7e75355eca9c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:00.262199 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ebb660e2-42b1-43d4-a5b2-7e75355eca9c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] [instance: 7546dd4f-e528-4cbe-914c-a1f008219334] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:00.274225 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ebb660e2-42b1-43d4-a5b2-7e75355eca9c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:00.274666 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ebb660e2-42b1-43d4-a5b2-7e75355eca9c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:00.275802 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ebb660e2-42b1-43d4-a5b2-7e75355eca9c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:00.276516 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ebb660e2-42b1-43d4-a5b2-7e75355eca9c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:00.295792 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-ebb660e2-42b1-43d4-a5b2-7e75355eca9c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] HTTP exception thrown: Instance 7546dd4f-e528-4cbe-914c-a1f008219334 could not be found. Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ebb660e2-42b1-43d4-a5b2-7e75355eca9c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Request method failure captured: Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 HTTP/1.1 Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ8x9-9N1mvfWxH30CplXn2yDjGyrAlTE3YSRrgwXHd6ZaQ3xM8FNWpU22GYvPB3-ZO4H29y10W5bDUgJdwcj4NbuA4aHbrbhxL51G1lhbrqGHeYC79Zml5P2rh5EtRffq-fnsNHijvSKpHyMqCTMObh-mW8t_JJ3bl4_UPPWWmMzoE Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: aa636b31dd844b93b83300a3de1418ce Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-VolumesActionsTest-1185832151 Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:15:00.297524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:15:00.299080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/aa636b31dd844b93b83300a3de1418ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aa636b31dd844b93b83300a3de1418ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_aa636b31dd844b93b83300a3de1418ce", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/aa636b31dd844b93b83300a3de1418ce"}]}] Jun 23 17:15:00.299080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-VolumesActionsTest-1185832151 Jun 23 17:15:00.299080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: aa636b31dd844b93b83300a3de1418ce Jun 23 17:15:00.299080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-VolumesActionsTest-1185832151 Jun 23 17:15:00.299080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-VolumesActionsTest-1185832151-project Jun 23 17:15:00.299080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:15:00.299080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:15:00.299080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 89d1af25b199404b9f432b21c825b447 Jun 23 17:15:00.299080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-VolumesActionsTest-1185832151-project Jun 23 17:15:00.299080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:15:00.299080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance 7546dd4f-e528-4cbe-914c-a1f008219334 could not be found. Jun 23 17:15:00.299080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '7546dd4f-e528-4cbe-914c-a1f008219334'} Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7546dd4f-e528-4cbe-914c-a1f008219334 could not be found. Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:15:00.299976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7546dd4f-e528-4cbe-914c-a1f008219334 could not be found. Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7546dd4f-e528-4cbe-914c-a1f008219334 could not be found. Jun 23 17:15:00.301237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:15:00.311081 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ebb660e2-42b1-43d4-a5b2-7e75355eca9c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] Returning 404 to user: Instance 7546dd4f-e528-4cbe-914c-a1f008219334 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:15:00.311081 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ebb660e2-42b1-43d4-a5b2-7e75355eca9c tempest-VolumesActionsTest-1185832151 tempest-VolumesActionsTest-1185832151-project] 10.222.0.18 "GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334" status: 404 len: 111 microversion: 2.1 time: 0.042074 Jun 23 17:15:00.311081 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 225/449] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:00 2022] GET /compute/v2.1/servers/7546dd4f-e528-4cbe-914c-a1f008219334 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:15:01.070936 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2afe8d8e-141b-4339-ac51-a089b8c6611b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:01.071967 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2afe8d8e-141b-4339-ac51-a089b8c6611b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:01.082629 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2afe8d8e-141b-4339-ac51-a089b8c6611b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:01.083178 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2afe8d8e-141b-4339-ac51-a089b8c6611b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:01.083954 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2afe8d8e-141b-4339-ac51-a089b8c6611b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:01.084402 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2afe8d8e-141b-4339-ac51-a089b8c6611b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:01.261358 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2afe8d8e-141b-4339-ac51-a089b8c6611b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:01.264917 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:01.271020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2afe8d8e-141b-4339-ac51-a089b8c6611b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.203229 Jun 23 17:15:01.271788 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 225/450] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:01 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:02.290757 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b4fdda4a-262e-4b8f-b547-9e8908c1de33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:02.291766 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b4fdda4a-262e-4b8f-b547-9e8908c1de33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:02.304482 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b4fdda4a-262e-4b8f-b547-9e8908c1de33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:02.305266 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b4fdda4a-262e-4b8f-b547-9e8908c1de33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:02.310034 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b4fdda4a-262e-4b8f-b547-9e8908c1de33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:02.310545 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b4fdda4a-262e-4b8f-b547-9e8908c1de33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:02.613892 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b4fdda4a-262e-4b8f-b547-9e8908c1de33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:02.624226 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b4fdda4a-262e-4b8f-b547-9e8908c1de33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.339365 Jun 23 17:15:02.637005 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 226/451] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:02 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:03.645030 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-30f91cff-645c-46f5-ba22-31e36796fd1f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:03.646115 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-30f91cff-645c-46f5-ba22-31e36796fd1f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:03.659364 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30f91cff-645c-46f5-ba22-31e36796fd1f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:03.659808 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30f91cff-645c-46f5-ba22-31e36796fd1f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:03.662320 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30f91cff-645c-46f5-ba22-31e36796fd1f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:03.663154 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30f91cff-645c-46f5-ba22-31e36796fd1f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:03.828592 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-30f91cff-645c-46f5-ba22-31e36796fd1f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:03.841952 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-30f91cff-645c-46f5-ba22-31e36796fd1f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.201230 Jun 23 17:15:03.842446 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 226/452] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:03 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:04.859245 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6eddaa65-c4b8-4ec9-8bb1-eaa1ba7a63ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:04.859844 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6eddaa65-c4b8-4ec9-8bb1-eaa1ba7a63ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:04.878743 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6eddaa65-c4b8-4ec9-8bb1-eaa1ba7a63ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:04.886433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6eddaa65-c4b8-4ec9-8bb1-eaa1ba7a63ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:04.887507 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6eddaa65-c4b8-4ec9-8bb1-eaa1ba7a63ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:04.887935 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6eddaa65-c4b8-4ec9-8bb1-eaa1ba7a63ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:05.061817 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6eddaa65-c4b8-4ec9-8bb1-eaa1ba7a63ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:05.073252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6eddaa65-c4b8-4ec9-8bb1-eaa1ba7a63ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.217625 Jun 23 17:15:05.074490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 227/453] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:04 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:06.090801 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-763aa3d5-06bc-4acc-b3a6-bd8930caec31 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:06.091967 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-763aa3d5-06bc-4acc-b3a6-bd8930caec31 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:06.099708 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-763aa3d5-06bc-4acc-b3a6-bd8930caec31 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:06.100335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-763aa3d5-06bc-4acc-b3a6-bd8930caec31 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:06.101072 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-763aa3d5-06bc-4acc-b3a6-bd8930caec31 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:06.101473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-763aa3d5-06bc-4acc-b3a6-bd8930caec31 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:06.290149 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-763aa3d5-06bc-4acc-b3a6-bd8930caec31 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:06.298769 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-763aa3d5-06bc-4acc-b3a6-bd8930caec31 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.212221 Jun 23 17:15:06.300046 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 227/454] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:06 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:07.317367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1217c779-3b74-4c60-957d-89227a3cafff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:07.319192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1217c779-3b74-4c60-957d-89227a3cafff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:07.322005 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=72 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:07.327985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1217c779-3b74-4c60-957d-89227a3cafff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:07.328632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1217c779-3b74-4c60-957d-89227a3cafff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:07.329394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1217c779-3b74-4c60-957d-89227a3cafff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:07.330070 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1217c779-3b74-4c60-957d-89227a3cafff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:07.539159 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1217c779-3b74-4c60-957d-89227a3cafff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:07.553541 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1217c779-3b74-4c60-957d-89227a3cafff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.239444 Jun 23 17:15:07.554668 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 228/455] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:07 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:08.574696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-efb5ca92-9915-4075-913a-a868da587465 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:08.581567 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-efb5ca92-9915-4075-913a-a868da587465 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:08.604757 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:08.612454 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efb5ca92-9915-4075-913a-a868da587465 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:08.614640 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efb5ca92-9915-4075-913a-a868da587465 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:08.615951 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efb5ca92-9915-4075-913a-a868da587465 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:08.617102 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efb5ca92-9915-4075-913a-a868da587465 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:09.453126 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-efb5ca92-9915-4075-913a-a868da587465 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:09.461299 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-efb5ca92-9915-4075-913a-a868da587465 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.894229 Jun 23 17:15:09.466624 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 228/456] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:08 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:10.483577 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3281dc57-9478-4dc2-a802-68d66ce53ee9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:10.485596 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3281dc57-9478-4dc2-a802-68d66ce53ee9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:10.499091 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3281dc57-9478-4dc2-a802-68d66ce53ee9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:10.502952 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3281dc57-9478-4dc2-a802-68d66ce53ee9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:10.506852 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3281dc57-9478-4dc2-a802-68d66ce53ee9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:10.507638 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3281dc57-9478-4dc2-a802-68d66ce53ee9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:11.020715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3281dc57-9478-4dc2-a802-68d66ce53ee9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:11.037031 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3281dc57-9478-4dc2-a802-68d66ce53ee9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.557809 Jun 23 17:15:11.037714 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 229/457] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:10 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:15:12.055453 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d2705474-fa1c-4486-a7f4-edb1cbe5674d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:12.056069 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d2705474-fa1c-4486-a7f4-edb1cbe5674d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:12.067361 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2705474-fa1c-4486-a7f4-edb1cbe5674d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:12.068188 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2705474-fa1c-4486-a7f4-edb1cbe5674d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:12.069426 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2705474-fa1c-4486-a7f4-edb1cbe5674d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:12.070171 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2705474-fa1c-4486-a7f4-edb1cbe5674d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:12.343264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d2705474-fa1c-4486-a7f4-edb1cbe5674d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:12.358590 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d2705474-fa1c-4486-a7f4-edb1cbe5674d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.308095 Jun 23 17:15:12.359394 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 229/458] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:12 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:13.376019 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1ddb1e94-12f4-4618-87fe-6b47537268b3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:13.376642 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1ddb1e94-12f4-4618-87fe-6b47537268b3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:13.385956 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1ddb1e94-12f4-4618-87fe-6b47537268b3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:13.386510 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1ddb1e94-12f4-4618-87fe-6b47537268b3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:13.387491 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1ddb1e94-12f4-4618-87fe-6b47537268b3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:13.388036 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1ddb1e94-12f4-4618-87fe-6b47537268b3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:13.800957 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1ddb1e94-12f4-4618-87fe-6b47537268b3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:13.815137 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1ddb1e94-12f4-4618-87fe-6b47537268b3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.442597 Jun 23 17:15:13.821391 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 230/459] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:13 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:14.468160 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7276a547-dd23-4df5-ba5d-658d6af24b13 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Action: 'create', calling method: .version_select at 0x7f342e478ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1835957938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1IclCRWo/S8ADLjl4XaIEnLUO8VfCO4ghdPn6Sn8/k0/ZLdkMMAM2pwxtyFHEQT26A2JeeuWw3QHL9SHUQo+eAyef/XwMJYBqsx4CJCL7j57OyPcrSVEmFLeziUQPqdw=="}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:15:14.488887 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-7276a547-dd23-4df5-ba5d-658d6af24b13 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Getting quotas for project e393091e3c2d42e79e9f2ec80d471faf. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:15:14.493000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-7276a547-dd23-4df5-ba5d-658d6af24b13 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Getting quotas for user d21524f4232648ebaed76e1d7d5daf5f and project e393091e3c2d42e79e9f2ec80d471faf. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:15:14.537615 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7276a547-dd23-4df5-ba5d-658d6af24b13 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.431171 Jun 23 17:15:14.538467 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 230/460] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 23 17:15:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:15:14.841129 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d84c1ebf-9aa0-4bf3-8865-18affc2b5178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:14.842356 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d84c1ebf-9aa0-4bf3-8865-18affc2b5178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:14.853523 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d84c1ebf-9aa0-4bf3-8865-18affc2b5178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:14.856631 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d84c1ebf-9aa0-4bf3-8865-18affc2b5178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:14.857503 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d84c1ebf-9aa0-4bf3-8865-18affc2b5178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:14.859244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d84c1ebf-9aa0-4bf3-8865-18affc2b5178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:15.014155 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d84c1ebf-9aa0-4bf3-8865-18affc2b5178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:15.022353 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d84c1ebf-9aa0-4bf3-8865-18affc2b5178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.191072 Jun 23 17:15:15.023049 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 231/461] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:14 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:16.045719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ed967da2-503d-48b8-b0e8-350cb6492a53 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:16.046992 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ed967da2-503d-48b8-b0e8-350cb6492a53 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:16.057972 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed967da2-503d-48b8-b0e8-350cb6492a53 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:16.058979 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed967da2-503d-48b8-b0e8-350cb6492a53 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:16.061051 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed967da2-503d-48b8-b0e8-350cb6492a53 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:16.061877 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed967da2-503d-48b8-b0e8-350cb6492a53 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:16.269148 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ed967da2-503d-48b8-b0e8-350cb6492a53 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:16.285051 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ed967da2-503d-48b8-b0e8-350cb6492a53 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.244921 Jun 23 17:15:16.286158 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 231/462] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:16 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:17.303886 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-0ecd87c4-5198-490a-84b5-de23c243d238 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:17.305270 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-0ecd87c4-5198-490a-84b5-de23c243d238 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:17.314881 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0ecd87c4-5198-490a-84b5-de23c243d238 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:17.315722 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0ecd87c4-5198-490a-84b5-de23c243d238 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:17.319291 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0ecd87c4-5198-490a-84b5-de23c243d238 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:17.320035 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0ecd87c4-5198-490a-84b5-de23c243d238 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:17.373105 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:17.541333 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-0ecd87c4-5198-490a-84b5-de23c243d238 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:17.554669 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-0ecd87c4-5198-490a-84b5-de23c243d238 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.254925 Jun 23 17:15:17.559165 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 232/463] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:17 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:18.581013 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e9cc9a5c-4991-4524-b9da-22b17d5a5bf8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:18.582551 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e9cc9a5c-4991-4524-b9da-22b17d5a5bf8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:18.593922 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9cc9a5c-4991-4524-b9da-22b17d5a5bf8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:18.593922 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9cc9a5c-4991-4524-b9da-22b17d5a5bf8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:18.593922 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9cc9a5c-4991-4524-b9da-22b17d5a5bf8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:18.593922 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9cc9a5c-4991-4524-b9da-22b17d5a5bf8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:18.830406 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e9cc9a5c-4991-4524-b9da-22b17d5a5bf8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:18.843563 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e9cc9a5c-4991-4524-b9da-22b17d5a5bf8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.270340 Jun 23 17:15:18.860021 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 232/464] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:18 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:19.871171 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4f269843-2e2f-4f7d-8297-535b74e93105 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:19.872502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4f269843-2e2f-4f7d-8297-535b74e93105 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:19.879713 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4f269843-2e2f-4f7d-8297-535b74e93105 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:19.881044 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4f269843-2e2f-4f7d-8297-535b74e93105 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:19.882136 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4f269843-2e2f-4f7d-8297-535b74e93105 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:19.882803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4f269843-2e2f-4f7d-8297-535b74e93105 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:20.073110 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4f269843-2e2f-4f7d-8297-535b74e93105 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:20.082948 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4f269843-2e2f-4f7d-8297-535b74e93105 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.216297 Jun 23 17:15:20.088249 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 233/465] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:19 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:15:21.105404 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cd371c10-3b17-4ad2-b2ed-acb5485a2e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:21.106062 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cd371c10-3b17-4ad2-b2ed-acb5485a2e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:21.114405 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd371c10-3b17-4ad2-b2ed-acb5485a2e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:21.116080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd371c10-3b17-4ad2-b2ed-acb5485a2e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:21.121335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd371c10-3b17-4ad2-b2ed-acb5485a2e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:21.121805 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd371c10-3b17-4ad2-b2ed-acb5485a2e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:21.422327 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-cd371c10-3b17-4ad2-b2ed-acb5485a2e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:21.444287 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cd371c10-3b17-4ad2-b2ed-acb5485a2e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.342559 Jun 23 17:15:21.445118 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 233/466] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:21 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:15:22.348435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2024251822", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1616861067", "security_groups": [{"name": "tempest-secgroup-smoke-1592527015"}], "networks": [{"uuid": "3a5ff66a-a5af-42f3-a3ab-c222fd0cd2f8"}], "block_device_mapping_v2": [{"uuid": "e2cbbc1d-d91a-4c02-99c1-293f189d577f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:15:22.464988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cca10837-3cb9-4416-8255-5cd3bc9a5ff4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:22.466128 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cca10837-3cb9-4416-8255-5cd3bc9a5ff4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:22.483933 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cca10837-3cb9-4416-8255-5cd3bc9a5ff4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:22.492557 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cca10837-3cb9-4416-8255-5cd3bc9a5ff4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:22.494214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cca10837-3cb9-4416-8255-5cd3bc9a5ff4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:22.494871 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cca10837-3cb9-4416-8255-5cd3bc9a5ff4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:22.548936 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.network.neutron [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] validate_networks() for [('3a5ff66a-a5af-42f3-a3ab-c222fd0cd2f8', None, None, None, None, None)] {{(pid=117897) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:15:22.978677 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-cca10837-3cb9-4416-8255-5cd3bc9a5ff4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:22.986957 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cca10837-3cb9-4416-8255-5cd3bc9a5ff4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.527997 Jun 23 17:15:22.991130 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 234/467] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:22 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:23.182322 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Flavor limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:15:23.183163 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Image limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:15:23.183818 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Flavor pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:15:23.184232 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Image pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:15:23.184640 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:15:23.198876 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:23.200422 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:23.202114 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:23.202946 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:23.247183 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Getting quotas for project e456e86229d84ae28c56cf25357f99bc. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:15:23.254156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Getting quotas for user 9a1e3a5739ac4a46beb0baa8887660f5 and project e456e86229d84ae28c56cf25357f99bc. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:15:23.340738 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Going to run 1 instances... {{(pid=117897) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:15:23.343630 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e2cbbc1d-d91a-4c02-99c1-293f189d577f',volume_size=None,volume_type=None)] {{(pid=117897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:15:23.544491 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b76ddce8-3f26-4e09-8862-d9fb52cc7d45 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.201913 Jun 23 17:15:23.581054 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c22306b7-15cb-4cd9-912e-7e0139381627 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:23.581823 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 234/468] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:15:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:15:23.585925 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c22306b7-15cb-4cd9-912e-7e0139381627 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:23.684954 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c22306b7-15cb-4cd9-912e-7e0139381627 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:23.701317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c22306b7-15cb-4cd9-912e-7e0139381627 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1089 microversion: 2.1 time: 0.124200 Jun 23 17:15:23.701932 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 235/469] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:23 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1089 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:24.008202 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-338581e1-6118-481b-b67f-9bb26feed2ee tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:24.009165 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-338581e1-6118-481b-b67f-9bb26feed2ee tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:24.024929 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-338581e1-6118-481b-b67f-9bb26feed2ee tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:24.025389 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-338581e1-6118-481b-b67f-9bb26feed2ee tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:24.028700 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-338581e1-6118-481b-b67f-9bb26feed2ee tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:24.030566 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-338581e1-6118-481b-b67f-9bb26feed2ee tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:24.434986 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-338581e1-6118-481b-b67f-9bb26feed2ee tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:24.445571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-338581e1-6118-481b-b67f-9bb26feed2ee tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.441900 Jun 23 17:15:24.446189 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 235/470] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:24 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:24.720993 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ab88cb62-9dfd-4f17-acad-b9804a0c5ae9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:24.722477 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ab88cb62-9dfd-4f17-acad-b9804a0c5ae9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:24.745020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ab88cb62-9dfd-4f17-acad-b9804a0c5ae9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:24.746574 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ab88cb62-9dfd-4f17-acad-b9804a0c5ae9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:24.747824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ab88cb62-9dfd-4f17-acad-b9804a0c5ae9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:24.748547 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ab88cb62-9dfd-4f17-acad-b9804a0c5ae9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:24.862556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ab88cb62-9dfd-4f17-acad-b9804a0c5ae9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:24.880032 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ab88cb62-9dfd-4f17-acad-b9804a0c5ae9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1131 microversion: 2.1 time: 0.164974 Jun 23 17:15:24.881603 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 236/471] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:24 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1131 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:25.467447 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-74d4dca8-07f8-41a5-8e6f-95306b40b97f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:25.469072 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-74d4dca8-07f8-41a5-8e6f-95306b40b97f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:25.480748 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-74d4dca8-07f8-41a5-8e6f-95306b40b97f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:25.482170 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-74d4dca8-07f8-41a5-8e6f-95306b40b97f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:25.483596 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-74d4dca8-07f8-41a5-8e6f-95306b40b97f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:25.484642 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-74d4dca8-07f8-41a5-8e6f-95306b40b97f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:25.900518 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4fc35be1-8080-4532-b9f0-f5b1ba80cd53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:25.902086 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4fc35be1-8080-4532-b9f0-f5b1ba80cd53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:25.919161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4fc35be1-8080-4532-b9f0-f5b1ba80cd53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:25.919985 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4fc35be1-8080-4532-b9f0-f5b1ba80cd53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:25.921935 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4fc35be1-8080-4532-b9f0-f5b1ba80cd53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:25.922674 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4fc35be1-8080-4532-b9f0-f5b1ba80cd53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:26.046070 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-74d4dca8-07f8-41a5-8e6f-95306b40b97f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:26.057000 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-74d4dca8-07f8-41a5-8e6f-95306b40b97f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.594364 Jun 23 17:15:26.058110 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 236/472] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:25 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:26.065135 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4fc35be1-8080-4532-b9f0-f5b1ba80cd53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:26.083120 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4fc35be1-8080-4532-b9f0-f5b1ba80cd53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1187 microversion: 2.1 time: 0.189023 Jun 23 17:15:26.092981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 237/473] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:25 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1187 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:15:27.078360 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-adf94984-c979-4e1c-93e4-e8e513be530e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:27.079780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-adf94984-c979-4e1c-93e4-e8e513be530e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:27.095051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-adf94984-c979-4e1c-93e4-e8e513be530e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:27.096366 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-adf94984-c979-4e1c-93e4-e8e513be530e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:27.097554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-adf94984-c979-4e1c-93e4-e8e513be530e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:27.098231 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-adf94984-c979-4e1c-93e4-e8e513be530e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:27.100398 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8c320815-129c-4323-ab07-d2f9ca8ce13e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:27.101015 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8c320815-129c-4323-ab07-d2f9ca8ce13e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:27.116490 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8c320815-129c-4323-ab07-d2f9ca8ce13e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:27.116875 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8c320815-129c-4323-ab07-d2f9ca8ce13e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:27.118239 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8c320815-129c-4323-ab07-d2f9ca8ce13e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:27.118842 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8c320815-129c-4323-ab07-d2f9ca8ce13e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:27.407165 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-adf94984-c979-4e1c-93e4-e8e513be530e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:27.416189 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-adf94984-c979-4e1c-93e4-e8e513be530e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.344438 Jun 23 17:15:27.420687 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 237/474] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:27 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:27.456965 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8c320815-129c-4323-ab07-d2f9ca8ce13e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:27.480615 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8c320815-129c-4323-ab07-d2f9ca8ce13e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1205 microversion: 2.1 time: 0.384070 Jun 23 17:15:27.485341 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 238/475] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:27 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1205 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:28.433073 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-46f34145-5912-4739-83ad-f15d05e97795 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:28.434423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-46f34145-5912-4739-83ad-f15d05e97795 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:28.449646 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-46f34145-5912-4739-83ad-f15d05e97795 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:28.451002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-46f34145-5912-4739-83ad-f15d05e97795 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:28.454288 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-46f34145-5912-4739-83ad-f15d05e97795 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:28.456060 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-46f34145-5912-4739-83ad-f15d05e97795 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:28.506990 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9ddba9be-b2c2-444e-89bc-ca4cb7955e81 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:28.514205 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9ddba9be-b2c2-444e-89bc-ca4cb7955e81 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:28.529540 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ddba9be-b2c2-444e-89bc-ca4cb7955e81 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:28.539372 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ddba9be-b2c2-444e-89bc-ca4cb7955e81 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:28.540218 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ddba9be-b2c2-444e-89bc-ca4cb7955e81 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:28.545865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ddba9be-b2c2-444e-89bc-ca4cb7955e81 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:29.015291 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-46f34145-5912-4739-83ad-f15d05e97795 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:29.026961 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-46f34145-5912-4739-83ad-f15d05e97795 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.598153 Jun 23 17:15:29.029636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 238/476] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:28 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:29.078542 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9ddba9be-b2c2-444e-89bc-ca4cb7955e81 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:29.091947 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9ddba9be-b2c2-444e-89bc-ca4cb7955e81 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1261 microversion: 2.1 time: 0.591005 Jun 23 17:15:29.092560 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 239/477] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:28 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1261 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:30.047215 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6dfa995d-3faf-4125-9794-24eed1a253ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:30.048138 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6dfa995d-3faf-4125-9794-24eed1a253ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:30.057742 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6dfa995d-3faf-4125-9794-24eed1a253ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:30.061741 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6dfa995d-3faf-4125-9794-24eed1a253ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:30.063072 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6dfa995d-3faf-4125-9794-24eed1a253ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:30.063770 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6dfa995d-3faf-4125-9794-24eed1a253ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:30.112177 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-773cf220-dd4c-4198-a770-8aadb155caf9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:30.113354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-773cf220-dd4c-4198-a770-8aadb155caf9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:30.123608 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-773cf220-dd4c-4198-a770-8aadb155caf9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:30.124055 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-773cf220-dd4c-4198-a770-8aadb155caf9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:30.125009 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-773cf220-dd4c-4198-a770-8aadb155caf9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:30.125444 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-773cf220-dd4c-4198-a770-8aadb155caf9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:30.369589 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6dfa995d-3faf-4125-9794-24eed1a253ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:30.380574 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6dfa995d-3faf-4125-9794-24eed1a253ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.337789 Jun 23 17:15:30.393253 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 239/478] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:30 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:30.728155 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-773cf220-dd4c-4198-a770-8aadb155caf9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:30.742286 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-773cf220-dd4c-4198-a770-8aadb155caf9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1261 microversion: 2.1 time: 0.633984 Jun 23 17:15:30.746239 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 240/479] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:30 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1261 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:15:31.189603 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-2442b596-8157-4e91-8030-981a42b4dc40 req-d7153d33-b097-4703-844d-ad65a799aee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eed0594-b0c2-4c93-a04b-898a6e02ca06", "tag": "0ea26bf7-a55b-43ac-9717-c694d5cc21f4"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:15:31.217373 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-2442b596-8157-4e91-8030-981a42b4dc40 req-d7153d33-b097-4703-844d-ad65a799aee9 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:31.217830 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-2442b596-8157-4e91-8030-981a42b4dc40 req-d7153d33-b097-4703-844d-ad65a799aee9 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:31.240210 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-2442b596-8157-4e91-8030-981a42b4dc40 req-d7153d33-b097-4703-844d-ad65a799aee9 service nova] Creating event network-changed:0ea26bf7-a55b-43ac-9717-c694d5cc21f4 for instance 4eed0594-b0c2-4c93-a04b-898a6e02ca06 on hv-cinder-83538 Jun 23 17:15:31.259640 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-2442b596-8157-4e91-8030-981a42b4dc40 req-d7153d33-b097-4703-844d-ad65a799aee9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091322 Jun 23 17:15:31.260749 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 240/480] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:15:31.402698 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3589e353-db42-4592-a34e-3d314c8f5372 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:31.403267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3589e353-db42-4592-a34e-3d314c8f5372 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:31.411497 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3589e353-db42-4592-a34e-3d314c8f5372 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:31.411956 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3589e353-db42-4592-a34e-3d314c8f5372 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:31.412741 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3589e353-db42-4592-a34e-3d314c8f5372 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:31.414557 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3589e353-db42-4592-a34e-3d314c8f5372 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:31.763250 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-8d4bb835-5bf6-4e9b-b1ea-3f0cbf8752dc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:31.763984 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-8d4bb835-5bf6-4e9b-b1ea-3f0cbf8752dc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:31.782567 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8d4bb835-5bf6-4e9b-b1ea-3f0cbf8752dc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:31.783359 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8d4bb835-5bf6-4e9b-b1ea-3f0cbf8752dc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:31.784615 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8d4bb835-5bf6-4e9b-b1ea-3f0cbf8752dc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:31.785237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8d4bb835-5bf6-4e9b-b1ea-3f0cbf8752dc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:32.026274 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3589e353-db42-4592-a34e-3d314c8f5372 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:32.039392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3589e353-db42-4592-a34e-3d314c8f5372 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.640969 Jun 23 17:15:32.043714 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 241/481] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:31 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:32.194402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-8d4bb835-5bf6-4e9b-b1ea-3f0cbf8752dc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:32.222472 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-8d4bb835-5bf6-4e9b-b1ea-3f0cbf8752dc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1261 microversion: 2.1 time: 0.462536 Jun 23 17:15:32.319670 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 241/482] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:31 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1261 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:33.073015 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b57d3734-330f-4948-af3c-ec58ffc439c9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:33.074347 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b57d3734-330f-4948-af3c-ec58ffc439c9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:33.082369 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b57d3734-330f-4948-af3c-ec58ffc439c9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:33.083599 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b57d3734-330f-4948-af3c-ec58ffc439c9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:33.113917 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b57d3734-330f-4948-af3c-ec58ffc439c9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:33.116555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b57d3734-330f-4948-af3c-ec58ffc439c9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:33.255269 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-10e783c0-f1ec-4747-9fe0-497396ada236 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:33.256642 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-10e783c0-f1ec-4747-9fe0-497396ada236 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:33.259240 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=2 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:33.263880 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=6 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:33.277643 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-10e783c0-f1ec-4747-9fe0-497396ada236 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:33.280432 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-10e783c0-f1ec-4747-9fe0-497396ada236 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:33.282237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-10e783c0-f1ec-4747-9fe0-497396ada236 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:33.284399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-10e783c0-f1ec-4747-9fe0-497396ada236 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:33.485998 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b57d3734-330f-4948-af3c-ec58ffc439c9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:33.499188 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b57d3734-330f-4948-af3c-ec58ffc439c9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.429908 Jun 23 17:15:33.511281 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 242/483] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:33 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:33.630674 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-10e783c0-f1ec-4747-9fe0-497396ada236 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:33.643438 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-10e783c0-f1ec-4747-9fe0-497396ada236 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1261 microversion: 2.1 time: 0.390699 Jun 23 17:15:33.644627 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 242/484] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:33 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1261 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:34.580324 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-209fbcc0-3e5a-472a-a660-0810bc0e3dce tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:34.581759 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-209fbcc0-3e5a-472a-a660-0810bc0e3dce tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:34.592010 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:34.596974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-209fbcc0-3e5a-472a-a660-0810bc0e3dce tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:34.603375 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-209fbcc0-3e5a-472a-a660-0810bc0e3dce tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:34.604989 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-209fbcc0-3e5a-472a-a660-0810bc0e3dce tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:34.605456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-209fbcc0-3e5a-472a-a660-0810bc0e3dce tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:34.621987 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=91 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:34.660908 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-cbf348f2-d916-4f0a-9d7d-74beba7c2c61 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:34.662484 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-cbf348f2-d916-4f0a-9d7d-74beba7c2c61 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:34.679009 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cbf348f2-d916-4f0a-9d7d-74beba7c2c61 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:34.679452 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cbf348f2-d916-4f0a-9d7d-74beba7c2c61 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:34.687038 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cbf348f2-d916-4f0a-9d7d-74beba7c2c61 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:34.687796 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cbf348f2-d916-4f0a-9d7d-74beba7c2c61 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:34.932442 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-209fbcc0-3e5a-472a-a660-0810bc0e3dce tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:34.942289 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-209fbcc0-3e5a-472a-a660-0810bc0e3dce tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.390896 Jun 23 17:15:34.945892 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 243/485] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:34 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:35.082140 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-cbf348f2-d916-4f0a-9d7d-74beba7c2c61 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:35.099224 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-cbf348f2-d916-4f0a-9d7d-74beba7c2c61 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1261 microversion: 2.1 time: 0.434866 Jun 23 17:15:35.111883 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 243/486] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:34 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1261 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:35.964147 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a65b2da2-6cf4-4adb-b8f3-ce75b24b4095 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:35.964758 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a65b2da2-6cf4-4adb-b8f3-ce75b24b4095 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:35.983275 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a65b2da2-6cf4-4adb-b8f3-ce75b24b4095 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:35.983723 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a65b2da2-6cf4-4adb-b8f3-ce75b24b4095 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:35.984520 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a65b2da2-6cf4-4adb-b8f3-ce75b24b4095 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:35.984991 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a65b2da2-6cf4-4adb-b8f3-ce75b24b4095 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:36.119843 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-12c4d20c-4b98-4b09-a1c1-5462994c58bc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:36.121107 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-12c4d20c-4b98-4b09-a1c1-5462994c58bc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:36.136349 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12c4d20c-4b98-4b09-a1c1-5462994c58bc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:36.137123 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12c4d20c-4b98-4b09-a1c1-5462994c58bc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:36.142696 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12c4d20c-4b98-4b09-a1c1-5462994c58bc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:36.148147 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12c4d20c-4b98-4b09-a1c1-5462994c58bc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:36.626321 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-12c4d20c-4b98-4b09-a1c1-5462994c58bc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:36.652234 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-12c4d20c-4b98-4b09-a1c1-5462994c58bc tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1261 microversion: 2.1 time: 0.535013 Jun 23 17:15:36.655810 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 244/487] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:36 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1261 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:15:36.724214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a65b2da2-6cf4-4adb-b8f3-ce75b24b4095 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:36.735649 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a65b2da2-6cf4-4adb-b8f3-ce75b24b4095 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.775944 Jun 23 17:15:36.743534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 244/488] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:35 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:37.673202 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-06adb006-8cbc-4a81-b0cb-48fe2d0795d2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:37.673817 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-06adb006-8cbc-4a81-b0cb-48fe2d0795d2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:37.677401 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:37.703144 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-06adb006-8cbc-4a81-b0cb-48fe2d0795d2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:37.703910 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-06adb006-8cbc-4a81-b0cb-48fe2d0795d2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:37.705377 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-06adb006-8cbc-4a81-b0cb-48fe2d0795d2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:37.706024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-06adb006-8cbc-4a81-b0cb-48fe2d0795d2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:37.760070 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-37ac30fb-fa17-4d28-81bc-abbbe4aeffeb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:37.760453 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-37ac30fb-fa17-4d28-81bc-abbbe4aeffeb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:37.794027 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37ac30fb-fa17-4d28-81bc-abbbe4aeffeb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:37.794833 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37ac30fb-fa17-4d28-81bc-abbbe4aeffeb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:37.800346 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37ac30fb-fa17-4d28-81bc-abbbe4aeffeb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:37.804973 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37ac30fb-fa17-4d28-81bc-abbbe4aeffeb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:38.029664 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-06adb006-8cbc-4a81-b0cb-48fe2d0795d2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:38.038892 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-06adb006-8cbc-4a81-b0cb-48fe2d0795d2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1261 microversion: 2.1 time: 0.369673 Jun 23 17:15:38.040244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 245/489] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:37 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1261 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:38.187724 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-37ac30fb-fa17-4d28-81bc-abbbe4aeffeb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:38.197276 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-37ac30fb-fa17-4d28-81bc-abbbe4aeffeb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.441395 Jun 23 17:15:38.198535 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 245/490] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:37 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:15:39.057355 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-21ce2c10-6de5-4d1a-a55a-cbb107866d37 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:39.057999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-21ce2c10-6de5-4d1a-a55a-cbb107866d37 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:39.076755 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-21ce2c10-6de5-4d1a-a55a-cbb107866d37 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:39.077202 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-21ce2c10-6de5-4d1a-a55a-cbb107866d37 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:39.078198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-21ce2c10-6de5-4d1a-a55a-cbb107866d37 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:39.078889 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-21ce2c10-6de5-4d1a-a55a-cbb107866d37 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:39.214868 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-53daa654-a99d-4a2f-996b-4d17999653ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:39.215536 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-53daa654-a99d-4a2f-996b-4d17999653ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:39.231075 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:39.241594 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-53daa654-a99d-4a2f-996b-4d17999653ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:39.245210 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-53daa654-a99d-4a2f-996b-4d17999653ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:39.247433 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-53daa654-a99d-4a2f-996b-4d17999653ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:39.249291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-53daa654-a99d-4a2f-996b-4d17999653ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:39.396856 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-21ce2c10-6de5-4d1a-a55a-cbb107866d37 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:39.414860 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-21ce2c10-6de5-4d1a-a55a-cbb107866d37 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1261 microversion: 2.1 time: 0.361693 Jun 23 17:15:39.420631 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 246/491] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:39 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1261 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:39.558823 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-53daa654-a99d-4a2f-996b-4d17999653ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:39.568131 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-53daa654-a99d-4a2f-996b-4d17999653ea tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1503 microversion: 2.1 time: 0.356084 Jun 23 17:15:39.571239 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 246/492] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:39 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1503 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:39.600638 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1bdec21e-6f2c-481c-8ca2-48d4b09dc576 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1467747f-0e54-4eb4-90d8-c47d4d294bf4"}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:15:39.602499 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1bdec21e-6f2c-481c-8ca2-48d4b09dc576 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:39.615611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1bdec21e-6f2c-481c-8ca2-48d4b09dc576 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:39.618269 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1bdec21e-6f2c-481c-8ca2-48d4b09dc576 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:39.619103 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1bdec21e-6f2c-481c-8ca2-48d4b09dc576 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:39.619550 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1bdec21e-6f2c-481c-8ca2-48d4b09dc576 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:39.670217 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-1bdec21e-6f2c-481c-8ca2-48d4b09dc576 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] HTTP exception thrown: Cannot 'attach_volume' instance 517df8d9-1e33-4448-a439-8ea166866a32 while it is in vm_state rescued Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1bdec21e-6f2c-481c-8ca2-48d4b09dc576 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Request method failure captured: Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: POST /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32/os-volume_attachments HTTP/1.1 Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 74 Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7mFXjOXoVpVDiV73DGaFoQ40dnVCIjXPuBt-YVKYyPM5lfbg2XseOWz8Hy8BcfTziAeJCIEfOhC6ANWOZDu7-5SMQaZLqZ9xDDe2MVgPKXO2USJmXiOEh-zZV6pl6aHTj4-U_og7W-dNSK8arRGdOb8W5jA06K1NkAAAQv7t6Km7w Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: bec9016d905e4d29b8e7c3f63c8a8810 Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:15:39.672999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:15:39.674433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bec9016d905e4d29b8e7c3f63c8a8810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bec9016d905e4d29b8e7c3f63c8a8810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bec9016d905e4d29b8e7c3f63c8a8810", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bec9016d905e4d29b8e7c3f63c8a8810"}]}] Jun 23 17:15:39.674433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:15:39.674433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: bec9016d905e4d29b8e7c3f63c8a8810 Jun 23 17:15:39.674433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:15:39.674433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-ServerRescueNegativeTestJSON-1610712579-project Jun 23 17:15:39.674433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:15:39.674433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:15:39.674433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: ccfccebbea724eca8909be4fea93a58f Jun 23 17:15:39.674433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1610712579-project Jun 23 17:15:39.674433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Jun 23 17:15:39.674433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {"volumeAttachment": {"volumeId": "1467747f-0e54-4eb4-90d8-c47d4d294bf4"}} Jun 23 17:15:39.674433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Cannot 'attach_volume' instance 517df8d9-1e33-4448-a439-8ea166866a32 while it is in vm_state rescued Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'server_id': '517df8d9-1e33-4448-a439-8ea166866a32', 'body': {'volumeAttachment': {'volumeId': '1467747f-0e54-4eb4-90d8-c47d4d294bf4'}}} Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 517df8d9-1e33-4448-a439-8ea166866a32 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:15:39.675211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 517df8d9-1e33-4448-a439-8ea166866a32 while it is in vm_state rescued Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:15:39.676475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:15:39.677620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:15:39.677620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:15:39.677620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 517df8d9-1e33-4448-a439-8ea166866a32 while it is in vm_state rescued Jun 23 17:15:39.677620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:15:39.679196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1bdec21e-6f2c-481c-8ca2-48d4b09dc576 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Returning 409 to user: Cannot 'attach_volume' instance 517df8d9-1e33-4448-a439-8ea166866a32 while it is in vm_state rescued {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:15:39.679733 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1bdec21e-6f2c-481c-8ca2-48d4b09dc576 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "POST /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.086530 Jun 23 17:15:39.684683 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 247/493] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 23 17:15:39 2022] POST /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32/os-volume_attachments => generated 152 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 23 17:15:39.690462 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1acc4792-4198-4996-981a-1b1de3f6a12f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:15:39.691001 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1acc4792-4198-4996-981a-1b1de3f6a12f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:39.702528 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1acc4792-4198-4996-981a-1b1de3f6a12f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:39.704918 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1acc4792-4198-4996-981a-1b1de3f6a12f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:39.705783 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1acc4792-4198-4996-981a-1b1de3f6a12f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:39.706280 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1acc4792-4198-4996-981a-1b1de3f6a12f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:39.844849 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1acc4792-4198-4996-981a-1b1de3f6a12f tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "POST /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32/action" status: 202 len: 0 microversion: 2.1 time: 0.158384 Jun 23 17:15:39.847026 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 247/494] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 23 17:15:39 2022] POST /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:15:39.855307 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-19f7f2cc-28c7-471c-8850-f81f9651802d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:39.856202 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-19f7f2cc-28c7-471c-8850-f81f9651802d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:39.863316 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-19f7f2cc-28c7-471c-8850-f81f9651802d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:39.864017 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-19f7f2cc-28c7-471c-8850-f81f9651802d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:39.865150 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-19f7f2cc-28c7-471c-8850-f81f9651802d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:39.866478 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-19f7f2cc-28c7-471c-8850-f81f9651802d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:40.090912 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-19f7f2cc-28c7-471c-8850-f81f9651802d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:40.100885 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-19f7f2cc-28c7-471c-8850-f81f9651802d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1511 microversion: 2.1 time: 0.248197 Jun 23 17:15:40.104883 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 248/495] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:39 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:40.451287 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-16ca823f-55fd-4c06-96ee-f7bff42f37c0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:40.452294 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-16ca823f-55fd-4c06-96ee-f7bff42f37c0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:40.466150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-16ca823f-55fd-4c06-96ee-f7bff42f37c0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:40.478481 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-16ca823f-55fd-4c06-96ee-f7bff42f37c0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:40.479506 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-16ca823f-55fd-4c06-96ee-f7bff42f37c0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:40.480056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-16ca823f-55fd-4c06-96ee-f7bff42f37c0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:40.792898 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-16ca823f-55fd-4c06-96ee-f7bff42f37c0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:40.804554 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-16ca823f-55fd-4c06-96ee-f7bff42f37c0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1261 microversion: 2.1 time: 0.367196 Jun 23 17:15:40.814283 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 248/496] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:40 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1261 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:41.127482 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ac81d165-98f1-4b9e-8451-2f9583d66167 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:41.129212 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ac81d165-98f1-4b9e-8451-2f9583d66167 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:41.138149 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ac81d165-98f1-4b9e-8451-2f9583d66167 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:41.139689 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ac81d165-98f1-4b9e-8451-2f9583d66167 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:41.140920 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ac81d165-98f1-4b9e-8451-2f9583d66167 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:41.141730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ac81d165-98f1-4b9e-8451-2f9583d66167 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:41.377855 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ac81d165-98f1-4b9e-8451-2f9583d66167 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:41.389649 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ac81d165-98f1-4b9e-8451-2f9583d66167 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1511 microversion: 2.1 time: 0.267691 Jun 23 17:15:41.390460 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 249/497] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:41 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:41.823378 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-00d5ab73-48d5-4717-ac93-1f121543b5f0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:41.823991 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-00d5ab73-48d5-4717-ac93-1f121543b5f0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:41.833980 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-00d5ab73-48d5-4717-ac93-1f121543b5f0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:41.834431 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-00d5ab73-48d5-4717-ac93-1f121543b5f0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:41.835198 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-00d5ab73-48d5-4717-ac93-1f121543b5f0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:41.837870 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-00d5ab73-48d5-4717-ac93-1f121543b5f0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:42.410509 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ba9bd73c-9f33-451c-8803-7cd65ff7b7a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:42.412025 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ba9bd73c-9f33-451c-8803-7cd65ff7b7a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:42.437416 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ba9bd73c-9f33-451c-8803-7cd65ff7b7a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:42.437770 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ba9bd73c-9f33-451c-8803-7cd65ff7b7a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:42.438724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ba9bd73c-9f33-451c-8803-7cd65ff7b7a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:42.439166 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ba9bd73c-9f33-451c-8803-7cd65ff7b7a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:42.585488 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-00d5ab73-48d5-4717-ac93-1f121543b5f0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:42.593712 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-00d5ab73-48d5-4717-ac93-1f121543b5f0 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1261 microversion: 2.1 time: 0.775318 Jun 23 17:15:42.603181 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 249/498] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:41 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1261 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:42.651429 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ba9bd73c-9f33-451c-8803-7cd65ff7b7a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:42.659104 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:42.664636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ba9bd73c-9f33-451c-8803-7cd65ff7b7a5 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1511 microversion: 2.1 time: 0.261060 Jun 23 17:15:42.665503 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 250/499] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:42 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:43.611193 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f09b44fe-c89f-4eef-b30a-bbbb3d50413d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:43.612902 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f09b44fe-c89f-4eef-b30a-bbbb3d50413d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:43.620294 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f09b44fe-c89f-4eef-b30a-bbbb3d50413d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:43.621298 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f09b44fe-c89f-4eef-b30a-bbbb3d50413d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:43.622791 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f09b44fe-c89f-4eef-b30a-bbbb3d50413d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:43.623565 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f09b44fe-c89f-4eef-b30a-bbbb3d50413d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:43.685492 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-16aac948-9d88-4c85-919d-977a86f9d1dc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:43.687705 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-16aac948-9d88-4c85-919d-977a86f9d1dc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:43.709735 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-16aac948-9d88-4c85-919d-977a86f9d1dc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:43.710522 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-16aac948-9d88-4c85-919d-977a86f9d1dc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:43.716633 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-16aac948-9d88-4c85-919d-977a86f9d1dc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:43.717370 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-16aac948-9d88-4c85-919d-977a86f9d1dc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:43.888617 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f09b44fe-c89f-4eef-b30a-bbbb3d50413d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:43.902377 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f09b44fe-c89f-4eef-b30a-bbbb3d50413d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1261 microversion: 2.1 time: 0.294809 Jun 23 17:15:43.914603 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 250/500] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:43 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1261 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:43.964102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-16aac948-9d88-4c85-919d-977a86f9d1dc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:43.975038 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-16aac948-9d88-4c85-919d-977a86f9d1dc tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1511 microversion: 2.1 time: 0.296000 Jun 23 17:15:43.976152 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 251/501] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:43 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1511 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:44.919449 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d3d2c8a3-6f24-4850-b6be-c4bf5f4ee93f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:44.920809 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d3d2c8a3-6f24-4850-b6be-c4bf5f4ee93f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:44.937852 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-24a95f1f-71ef-474d-af93-ba34c71fa69e req-9284461f-2064-4912-82f5-41bdd6ff50ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eed0594-b0c2-4c93-a04b-898a6e02ca06", "name": "network-vif-plugged", "status": "completed", "tag": "0ea26bf7-a55b-43ac-9717-c694d5cc21f4"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:15:44.960106 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3d2c8a3-6f24-4850-b6be-c4bf5f4ee93f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:44.962024 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3d2c8a3-6f24-4850-b6be-c4bf5f4ee93f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:44.964370 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-24a95f1f-71ef-474d-af93-ba34c71fa69e req-9284461f-2064-4912-82f5-41bdd6ff50ac service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:44.964743 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3d2c8a3-6f24-4850-b6be-c4bf5f4ee93f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:44.965563 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-24a95f1f-71ef-474d-af93-ba34c71fa69e req-9284461f-2064-4912-82f5-41bdd6ff50ac service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:44.967382 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3d2c8a3-6f24-4850-b6be-c4bf5f4ee93f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:45.001654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-24a95f1f-71ef-474d-af93-ba34c71fa69e req-9284461f-2064-4912-82f5-41bdd6ff50ac service nova] Creating event network-vif-plugged:0ea26bf7-a55b-43ac-9717-c694d5cc21f4 for instance 4eed0594-b0c2-4c93-a04b-898a6e02ca06 on hv-cinder-83538 Jun 23 17:15:45.030663 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-24a95f1f-71ef-474d-af93-ba34c71fa69e req-9284461f-2064-4912-82f5-41bdd6ff50ac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098079 Jun 23 17:15:45.032597 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 252/502] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:15:45.047225 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-687630f5-7a0c-4615-925f-1e59a3f91d48 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:45.049892 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-687630f5-7a0c-4615-925f-1e59a3f91d48 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:45.069025 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-687630f5-7a0c-4615-925f-1e59a3f91d48 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:45.069519 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-687630f5-7a0c-4615-925f-1e59a3f91d48 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:45.071272 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-687630f5-7a0c-4615-925f-1e59a3f91d48 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:45.071886 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-687630f5-7a0c-4615-925f-1e59a3f91d48 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:45.244990 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d3d2c8a3-6f24-4850-b6be-c4bf5f4ee93f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:45.258465 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d3d2c8a3-6f24-4850-b6be-c4bf5f4ee93f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1261 microversion: 2.1 time: 0.341276 Jun 23 17:15:45.260392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 251/503] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:44 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1261 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:45.511431 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-687630f5-7a0c-4615-925f-1e59a3f91d48 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:45.522732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-687630f5-7a0c-4615-925f-1e59a3f91d48 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1511 microversion: 2.1 time: 0.487018 Jun 23 17:15:45.524076 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 253/504] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:45 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1511 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:46.286221 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ce246ba4-e98b-4c26-82c9-0419ff305a11 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:46.287628 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ce246ba4-e98b-4c26-82c9-0419ff305a11 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:46.308397 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ce246ba4-e98b-4c26-82c9-0419ff305a11 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:46.317344 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ce246ba4-e98b-4c26-82c9-0419ff305a11 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:46.323067 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ce246ba4-e98b-4c26-82c9-0419ff305a11 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:46.326662 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ce246ba4-e98b-4c26-82c9-0419ff305a11 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:46.541504 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c5bd94f7-1447-4e30-8213-9f8a3e5cf9b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:46.542132 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c5bd94f7-1447-4e30-8213-9f8a3e5cf9b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:46.563396 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c5bd94f7-1447-4e30-8213-9f8a3e5cf9b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:46.565110 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c5bd94f7-1447-4e30-8213-9f8a3e5cf9b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:46.567442 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c5bd94f7-1447-4e30-8213-9f8a3e5cf9b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:46.569627 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c5bd94f7-1447-4e30-8213-9f8a3e5cf9b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:46.658241 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ce246ba4-e98b-4c26-82c9-0419ff305a11 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:46.674109 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ce246ba4-e98b-4c26-82c9-0419ff305a11 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1261 microversion: 2.1 time: 0.399536 Jun 23 17:15:46.675335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 252/505] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:46 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1261 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:46.843307 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1605874455", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1835957938", "security_groups": [{"name": "tempest-secgroup-smoke-1613163096"}], "block_device_mapping_v2": [{"uuid": "0a1f9374-e439-407d-a52b-9a59510f898e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e627980-fd3e-406b-86cf-dac9a328ca6c"}]}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:15:46.872642 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c5bd94f7-1447-4e30-8213-9f8a3e5cf9b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:46.889282 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c5bd94f7-1447-4e30-8213-9f8a3e5cf9b2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1517 microversion: 2.1 time: 0.352080 Jun 23 17:15:46.890523 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 254/506] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:46 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1517 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:47.045002 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] validate_networks() for [('7e627980-fd3e-406b-86cf-dac9a328ca6c', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:15:47.699899 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7da3cd31-3f29-4c41-8be6-18b9014380ad tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:47.701265 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7da3cd31-3f29-4c41-8be6-18b9014380ad tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:47.710176 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7da3cd31-3f29-4c41-8be6-18b9014380ad tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:47.710909 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7da3cd31-3f29-4c41-8be6-18b9014380ad tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:47.711883 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7da3cd31-3f29-4c41-8be6-18b9014380ad tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:47.712549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7da3cd31-3f29-4c41-8be6-18b9014380ad tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:47.743413 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:15:47.744584 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:15:47.745198 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:15:47.745755 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:15:47.746340 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:15:47.766839 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:47.767337 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:47.768230 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:47.768668 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:47.820057 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Getting quotas for project e393091e3c2d42e79e9f2ec80d471faf. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:15:47.832256 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Getting quotas for user d21524f4232648ebaed76e1d7d5daf5f and project e393091e3c2d42e79e9f2ec80d471faf. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:15:47.948829 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7da3cd31-3f29-4c41-8be6-18b9014380ad tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:47.961655 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7da3cd31-3f29-4c41-8be6-18b9014380ad tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1261 microversion: 2.1 time: 0.269826 Jun 23 17:15:47.966302 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 255/507] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:47 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1261 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:48.008829 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:15:48.011543 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a1f9374-e439-407d-a52b-9a59510f898e',volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:15:48.325749 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6d5565f3-85d1-4c35-8a7a-cb297f9b9c44 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.486524 Jun 23 17:15:48.337295 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-158c0abc-cfef-4054-a9c8-ef178c8cd047 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:48.338288 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-158c0abc-cfef-4054-a9c8-ef178c8cd047 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:48.345168 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 253/508] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:15:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:15:48.413230 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-158c0abc-cfef-4054-a9c8-ef178c8cd047 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:48.420215 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-158c0abc-cfef-4054-a9c8-ef178c8cd047 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1095 microversion: 2.1 time: 0.087183 Jun 23 17:15:48.430788 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 256/509] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:48 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:48.553144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f5837c8d-10e8-4da6-9247-b5cb80a2d2c4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Action: 'create', calling method: .version_select at 0x7f342e492d30>, body: {"keypair": {"name": "tempest-keypair-210919658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxv9HFqNMvjUasrwr1/bk7tdSqDNfo0vj6j0NUgDmwwLGOp/MyI+cPdzP0d5Z7zKJd/1qXS6Yz7cM95u2Xwa1/59nsG3aue41Wu7k7pzuly0pNyUhsWu+OtQJ08R8nPjQ=="}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:15:48.575805 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-f5837c8d-10e8-4da6-9247-b5cb80a2d2c4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Getting quotas for project bec9016d905e4d29b8e7c3f63c8a8810. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:15:48.583276 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-f5837c8d-10e8-4da6-9247-b5cb80a2d2c4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Getting quotas for user ccfccebbea724eca8909be4fea93a58f and project bec9016d905e4d29b8e7c3f63c8a8810. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:15:48.626483 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f5837c8d-10e8-4da6-9247-b5cb80a2d2c4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.077366 Jun 23 17:15:48.627678 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 254/510] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 23 17:15:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:15:48.980760 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-75529d14-f9b1-4fab-ae0d-16fbfd0bde27 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:48.981318 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-75529d14-f9b1-4fab-ae0d-16fbfd0bde27 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:48.991456 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-75529d14-f9b1-4fab-ae0d-16fbfd0bde27 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:48.992662 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-75529d14-f9b1-4fab-ae0d-16fbfd0bde27 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:48.993712 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-75529d14-f9b1-4fab-ae0d-16fbfd0bde27 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:48.994953 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-75529d14-f9b1-4fab-ae0d-16fbfd0bde27 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:49.216273 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-75529d14-f9b1-4fab-ae0d-16fbfd0bde27 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:49.227249 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-75529d14-f9b1-4fab-ae0d-16fbfd0bde27 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1445 microversion: 2.1 time: 0.251854 Jun 23 17:15:49.235879 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 257/511] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:48 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1445 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:49.246914 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b9381ff0-7663-4d2d-b0c5-1b6d8d8b11be tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:49.247684 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b9381ff0-7663-4d2d-b0c5-1b6d8d8b11be tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:49.266810 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9381ff0-7663-4d2d-b0c5-1b6d8d8b11be tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:49.267264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9381ff0-7663-4d2d-b0c5-1b6d8d8b11be tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:49.268036 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9381ff0-7663-4d2d-b0c5-1b6d8d8b11be tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:49.268462 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9381ff0-7663-4d2d-b0c5-1b6d8d8b11be tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:49.439227 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-de8bbedb-9f11-4647-8e10-0e58a397ef14 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:49.440123 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-de8bbedb-9f11-4647-8e10-0e58a397ef14 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:49.448444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-de8bbedb-9f11-4647-8e10-0e58a397ef14 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:49.450427 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-de8bbedb-9f11-4647-8e10-0e58a397ef14 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:49.452345 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-de8bbedb-9f11-4647-8e10-0e58a397ef14 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:49.452959 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-de8bbedb-9f11-4647-8e10-0e58a397ef14 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:49.510035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b9381ff0-7663-4d2d-b0c5-1b6d8d8b11be tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:49.519459 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b9381ff0-7663-4d2d-b0c5-1b6d8d8b11be tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1445 microversion: 2.1 time: 0.278829 Jun 23 17:15:49.520826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 255/512] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:49 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1445 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:49.579235 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-de8bbedb-9f11-4647-8e10-0e58a397ef14 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:49.591868 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-de8bbedb-9f11-4647-8e10-0e58a397ef14 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1137 microversion: 2.1 time: 0.157022 Jun 23 17:15:49.593144 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 258/513] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:49 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1137 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:50.610049 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b4e00c5a-e713-4606-96e8-b510d6ffff63 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:50.611317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b4e00c5a-e713-4606-96e8-b510d6ffff63 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:50.622228 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b4e00c5a-e713-4606-96e8-b510d6ffff63 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:50.624351 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b4e00c5a-e713-4606-96e8-b510d6ffff63 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:50.625768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b4e00c5a-e713-4606-96e8-b510d6ffff63 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:50.626854 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b4e00c5a-e713-4606-96e8-b510d6ffff63 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:50.781104 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b4e00c5a-e713-4606-96e8-b510d6ffff63 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:50.794808 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b4e00c5a-e713-4606-96e8-b510d6ffff63 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1137 microversion: 2.1 time: 0.189060 Jun 23 17:15:50.805518 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 256/514] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:50 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1137 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:50.884543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1388289133", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8527c448-8fef-4029-974e-c0de37b33eab"}], "security_groups": [{"name": "tempest-securitygroup--1450697269"}], "key_name": "tempest-keypair-210919658", "user_data": "}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:15:51.040072 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.network.neutron [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] validate_networks() for [('8527c448-8fef-4029-974e-c0de37b33eab', None, None, None, None, None)] {{(pid=117897) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:15:51.611914 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Flavor limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:15:51.612382 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Image limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:15:51.612844 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Flavor pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:15:51.613244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Image pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:15:51.613914 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:15:51.625570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:51.626262 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:51.627198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:51.627807 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:51.652146 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Getting quotas for project bec9016d905e4d29b8e7c3f63c8a8810. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:15:51.658249 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Getting quotas for user ccfccebbea724eca8909be4fea93a58f and project bec9016d905e4d29b8e7c3f63c8a8810. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:15:51.674848 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Going to run 1 instances... {{(pid=117897) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:15:51.677631 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:15:51.741132 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e4d7b1f5-e197-4d8c-9e6f-1a13ef2197a3 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.864133 Jun 23 17:15:51.742392 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 259/515] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:15:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:15:51.752387 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3dec8fd8-a759-42a6-a3db-6870b183c741 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:51.753762 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3dec8fd8-a759-42a6-a3db-6870b183c741 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:51.814207 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-41d776bc-3165-4a1b-9001-d95131ff90db tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:51.815094 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-41d776bc-3165-4a1b-9001-d95131ff90db tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:51.827524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-41d776bc-3165-4a1b-9001-d95131ff90db tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:51.830221 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3dec8fd8-a759-42a6-a3db-6870b183c741 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:51.830950 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-41d776bc-3165-4a1b-9001-d95131ff90db tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:51.834417 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-41d776bc-3165-4a1b-9001-d95131ff90db tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:51.835042 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-41d776bc-3165-4a1b-9001-d95131ff90db tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:51.839571 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3dec8fd8-a759-42a6-a3db-6870b183c741 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1245 microversion: 2.1 time: 0.090986 Jun 23 17:15:51.840464 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 257/516] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:51 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:51.957506 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-41d776bc-3165-4a1b-9001-d95131ff90db tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:51.972251 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-41d776bc-3165-4a1b-9001-d95131ff90db tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1137 microversion: 2.1 time: 0.163434 Jun 23 17:15:51.974868 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 260/517] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:51 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1137 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:52.120905 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-c4b9a1c8-df4d-4521-b894-599671bd2397 req-11df4b36-7437-4679-8fc7-972df9d86590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eed0594-b0c2-4c93-a04b-898a6e02ca06", "tag": "0ea26bf7-a55b-43ac-9717-c694d5cc21f4"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:15:52.133158 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c4b9a1c8-df4d-4521-b894-599671bd2397 req-11df4b36-7437-4679-8fc7-972df9d86590 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:52.133599 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c4b9a1c8-df4d-4521-b894-599671bd2397 req-11df4b36-7437-4679-8fc7-972df9d86590 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:52.148624 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-c4b9a1c8-df4d-4521-b894-599671bd2397 req-11df4b36-7437-4679-8fc7-972df9d86590 service nova] Creating event network-changed:0ea26bf7-a55b-43ac-9717-c694d5cc21f4 for instance 4eed0594-b0c2-4c93-a04b-898a6e02ca06 on hv-cinder-83538 Jun 23 17:15:52.156635 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-c4b9a1c8-df4d-4521-b894-599671bd2397 req-11df4b36-7437-4679-8fc7-972df9d86590 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039206 Jun 23 17:15:52.158327 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 258/518] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:15:52.859515 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3bb5ce5c-8135-4c1f-9697-a3e60ad72ef9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:52.865131 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3bb5ce5c-8135-4c1f-9697-a3e60ad72ef9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:52.882530 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3bb5ce5c-8135-4c1f-9697-a3e60ad72ef9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:52.883357 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3bb5ce5c-8135-4c1f-9697-a3e60ad72ef9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:52.884390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3bb5ce5c-8135-4c1f-9697-a3e60ad72ef9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:52.885043 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3bb5ce5c-8135-4c1f-9697-a3e60ad72ef9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:52.992449 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-92c636bc-006a-4aca-80ec-810cc1e7a1ed tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:52.993829 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-92c636bc-006a-4aca-80ec-810cc1e7a1ed tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:52.995915 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3bb5ce5c-8135-4c1f-9697-a3e60ad72ef9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:53.003629 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92c636bc-006a-4aca-80ec-810cc1e7a1ed tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:53.004398 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92c636bc-006a-4aca-80ec-810cc1e7a1ed tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:53.005840 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92c636bc-006a-4aca-80ec-810cc1e7a1ed tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:53.006448 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92c636bc-006a-4aca-80ec-810cc1e7a1ed tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:53.015171 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3bb5ce5c-8135-4c1f-9697-a3e60ad72ef9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1249 microversion: 2.1 time: 0.160194 Jun 23 17:15:53.016527 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 261/519] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:52 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1249 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:53.086098 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-92c636bc-006a-4aca-80ec-810cc1e7a1ed tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:53.094507 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-92c636bc-006a-4aca-80ec-810cc1e7a1ed tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1193 microversion: 2.1 time: 0.107446 Jun 23 17:15:53.095334 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 259/520] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:52 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1193 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:54.033369 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7a73898e-4518-46cf-9718-aaf46ecad5b7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:54.034012 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7a73898e-4518-46cf-9718-aaf46ecad5b7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:54.058872 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7a73898e-4518-46cf-9718-aaf46ecad5b7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:54.060100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7a73898e-4518-46cf-9718-aaf46ecad5b7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:54.068960 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7a73898e-4518-46cf-9718-aaf46ecad5b7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:54.072613 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7a73898e-4518-46cf-9718-aaf46ecad5b7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:54.111621 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bd3efceb-7684-4820-ae83-1190235c8d26 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:54.112249 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bd3efceb-7684-4820-ae83-1190235c8d26 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:54.121659 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bd3efceb-7684-4820-ae83-1190235c8d26 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:54.129007 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bd3efceb-7684-4820-ae83-1190235c8d26 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:54.134075 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bd3efceb-7684-4820-ae83-1190235c8d26 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:54.134632 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bd3efceb-7684-4820-ae83-1190235c8d26 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:54.263244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7a73898e-4518-46cf-9718-aaf46ecad5b7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:54.278875 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7a73898e-4518-46cf-9718-aaf46ecad5b7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1315 microversion: 2.1 time: 0.247277 Jun 23 17:15:54.281243 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 262/521] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:54 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:54.302487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bd3efceb-7684-4820-ae83-1190235c8d26 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:54.313865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bd3efceb-7684-4820-ae83-1190235c8d26 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1211 microversion: 2.1 time: 0.206036 Jun 23 17:15:54.314760 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 260/522] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:54 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1211 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:15:55.299407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-80a25cf4-cd23-4601-a462-a6d1b449e705 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:55.300962 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-80a25cf4-cd23-4601-a462-a6d1b449e705 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:55.311128 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-80a25cf4-cd23-4601-a462-a6d1b449e705 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:55.315264 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-80a25cf4-cd23-4601-a462-a6d1b449e705 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:55.318830 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-80a25cf4-cd23-4601-a462-a6d1b449e705 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:55.319496 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-80a25cf4-cd23-4601-a462-a6d1b449e705 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:55.331465 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e88080c1-4da7-4cc4-a7be-e315d0953d7d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:55.333346 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e88080c1-4da7-4cc4-a7be-e315d0953d7d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:55.357499 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e88080c1-4da7-4cc4-a7be-e315d0953d7d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:55.358451 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e88080c1-4da7-4cc4-a7be-e315d0953d7d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:55.359658 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e88080c1-4da7-4cc4-a7be-e315d0953d7d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:55.360317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e88080c1-4da7-4cc4-a7be-e315d0953d7d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:55.585885 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-80a25cf4-cd23-4601-a462-a6d1b449e705 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:55.606864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-80a25cf4-cd23-4601-a462-a6d1b449e705 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.312295 Jun 23 17:15:55.608116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 263/523] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:55 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:55.922009 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e88080c1-4da7-4cc4-a7be-e315d0953d7d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:55.929934 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e88080c1-4da7-4cc4-a7be-e315d0953d7d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.602604 Jun 23 17:15:55.931068 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 261/524] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:55 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:15:56.194854 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-95c0bae8-0733-4642-af77-b45d11895409 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Action: 'create', calling method: .version_select at 0x7f342de29700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1352412883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFlgdZR7jya6rrnae4rVEhJV4AJh6zVOoMPMxQ5L2l2nOiKGexYBfbVUWljTWPR9I9TH510TjdrYO3BGO5/BwTesCzURSiYyGhJsuUVITgjDr/xqmXUq2j+8tzSMb/rfg=="}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:15:56.222241 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-95c0bae8-0733-4642-af77-b45d11895409 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Getting quotas for project 26dde39423224c57b71005a60dacbed3. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:15:56.236470 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-95c0bae8-0733-4642-af77-b45d11895409 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Getting quotas for user fc83928b1a17490086c5698735ed5646 and project 26dde39423224c57b71005a60dacbed3. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:15:56.269973 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-95c0bae8-0733-4642-af77-b45d11895409 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.078897 Jun 23 17:15:56.270870 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 264/525] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 23 17:15:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:15:56.312624 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-592f9897-ecc0-46ce-8f7e-b7e316afe164 req-456323e5-e6a3-4445-97d1-d2377358b93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410f9789-fe14-436c-b928-5e32f1057008", "tag": "3cb62c73-34be-4c1e-ac1b-34d0ab60dbbf"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:15:56.328444 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-592f9897-ecc0-46ce-8f7e-b7e316afe164 req-456323e5-e6a3-4445-97d1-d2377358b93f service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:56.329514 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-592f9897-ecc0-46ce-8f7e-b7e316afe164 req-456323e5-e6a3-4445-97d1-d2377358b93f service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:56.336303 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:56.376161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-592f9897-ecc0-46ce-8f7e-b7e316afe164 req-456323e5-e6a3-4445-97d1-d2377358b93f service nova] Creating event network-changed:3cb62c73-34be-4c1e-ac1b-34d0ab60dbbf for instance 410f9789-fe14-436c-b928-5e32f1057008 on hv-cinder-83538 Jun 23 17:15:56.387182 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-592f9897-ecc0-46ce-8f7e-b7e316afe164 req-456323e5-e6a3-4445-97d1-d2377358b93f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079018 Jun 23 17:15:56.388815 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 262/526] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:15:56.428496 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-258667965", "imageRef": "650082cb-b33c-42b7-9205-388e2266d2e1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1352412883", "networks": [{"uuid": "2332f670-26c0-4a09-b312-dc7134c61067"}]}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:15:56.508476 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.network.neutron [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] validate_networks() for [('2332f670-26c0-4a09-b312-dc7134c61067', None, None, None, None, None)] {{(pid=117897) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:15:56.549844 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-f24dae32-e737-4e2d-ba31-95da2f28e338 req-e891c539-a6c1-47a6-8e23-8cc93d5783f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8f045dd-0ec4-4225-8bae-0035daa2c0ee", "tag": "5e0d8b7e-7e66-48e6-b53e-f85a41aeb721"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:15:56.565346 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-f24dae32-e737-4e2d-ba31-95da2f28e338 req-e891c539-a6c1-47a6-8e23-8cc93d5783f4 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:56.566010 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-f24dae32-e737-4e2d-ba31-95da2f28e338 req-e891c539-a6c1-47a6-8e23-8cc93d5783f4 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:56.578911 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-f24dae32-e737-4e2d-ba31-95da2f28e338 req-e891c539-a6c1-47a6-8e23-8cc93d5783f4 service nova] Creating event network-changed:5e0d8b7e-7e66-48e6-b53e-f85a41aeb721 for instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee on hv-cinder-83538 Jun 23 17:15:56.584021 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-f24dae32-e737-4e2d-ba31-95da2f28e338 req-e891c539-a6c1-47a6-8e23-8cc93d5783f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040650 Jun 23 17:15:56.584951 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 263/527] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:15:56.625999 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f3b905cc-ff2f-4207-9ddc-6420cac91263 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:56.627003 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f3b905cc-ff2f-4207-9ddc-6420cac91263 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:56.634375 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f3b905cc-ff2f-4207-9ddc-6420cac91263 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:56.635230 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f3b905cc-ff2f-4207-9ddc-6420cac91263 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:56.636192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f3b905cc-ff2f-4207-9ddc-6420cac91263 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:56.636795 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f3b905cc-ff2f-4207-9ddc-6420cac91263 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:56.880608 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f3b905cc-ff2f-4207-9ddc-6420cac91263 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:56.906699 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f3b905cc-ff2f-4207-9ddc-6420cac91263 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.285555 Jun 23 17:15:56.907378 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 264/528] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:56 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:56.949373 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8baf5df3-1773-4235-9736-198ae7c1d1dc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:56.950214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8baf5df3-1773-4235-9736-198ae7c1d1dc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:56.957771 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8baf5df3-1773-4235-9736-198ae7c1d1dc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:56.958686 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8baf5df3-1773-4235-9736-198ae7c1d1dc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:56.959651 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8baf5df3-1773-4235-9736-198ae7c1d1dc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:56.960217 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8baf5df3-1773-4235-9736-198ae7c1d1dc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:57.142037 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Flavor limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:15:57.142859 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Image limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:15:57.144288 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Flavor pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:15:57.150607 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Image pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:15:57.151807 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:15:57.164467 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:57.165183 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:57.166444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:57.167019 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:57.186812 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Getting quotas for project 26dde39423224c57b71005a60dacbed3. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:15:57.191379 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Getting quotas for user fc83928b1a17490086c5698735ed5646 and project 26dde39423224c57b71005a60dacbed3. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:15:57.211396 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Going to run 1 instances... {{(pid=117897) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:15:57.213816 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='650082cb-b33c-42b7-9205-388e2266d2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:15:57.236519 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8baf5df3-1773-4235-9736-198ae7c1d1dc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:57.245893 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8baf5df3-1773-4235-9736-198ae7c1d1dc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.301518 Jun 23 17:15:57.246580 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 265/529] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:56 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:57.263592 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-fd76aa7d-fcb2-4190-a0c2-5dd6fb843558 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839131 Jun 23 17:15:57.264243 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 265/530] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:15:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 17:15:57.275366 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-979d65c5-21b3-464e-91e3-85db2abcdba1 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:57.276299 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-979d65c5-21b3-464e-91e3-85db2abcdba1 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:57.341988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-979d65c5-21b3-464e-91e3-85db2abcdba1 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:57.352822 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-979d65c5-21b3-464e-91e3-85db2abcdba1 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1258 microversion: 2.1 time: 0.082373 Jun 23 17:15:57.353988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 266/531] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:57 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1258 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:57.927052 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-590787e2-f146-48e6-be20-7873aec07af4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:57.927660 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-590787e2-f146-48e6-be20-7873aec07af4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:57.935379 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-590787e2-f146-48e6-be20-7873aec07af4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:57.935873 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-590787e2-f146-48e6-be20-7873aec07af4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:57.936713 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-590787e2-f146-48e6-be20-7873aec07af4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:57.937188 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-590787e2-f146-48e6-be20-7873aec07af4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:58.078772 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-590787e2-f146-48e6-be20-7873aec07af4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:58.087088 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-590787e2-f146-48e6-be20-7873aec07af4 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.166618 Jun 23 17:15:58.087679 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 266/532] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:57 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:58.263518 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-17512da6-ece3-42a1-bf28-534e4649d3ee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:58.264153 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-17512da6-ece3-42a1-bf28-534e4649d3ee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:58.266104 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:58.274801 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-17512da6-ece3-42a1-bf28-534e4649d3ee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:58.275592 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-17512da6-ece3-42a1-bf28-534e4649d3ee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:58.276953 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-17512da6-ece3-42a1-bf28-534e4649d3ee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:58.277680 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-17512da6-ece3-42a1-bf28-534e4649d3ee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:58.371222 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5b2564d1-0c20-4b48-adf2-07573c5acabb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:58.371851 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5b2564d1-0c20-4b48-adf2-07573c5acabb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:58.381371 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5b2564d1-0c20-4b48-adf2-07573c5acabb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:58.381834 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5b2564d1-0c20-4b48-adf2-07573c5acabb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:58.382788 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5b2564d1-0c20-4b48-adf2-07573c5acabb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:58.383263 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5b2564d1-0c20-4b48-adf2-07573c5acabb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:58.414474 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-17512da6-ece3-42a1-bf28-534e4649d3ee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:58.422310 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-17512da6-ece3-42a1-bf28-534e4649d3ee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.162551 Jun 23 17:15:58.423602 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 267/533] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:58 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:58.450445 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5b2564d1-0c20-4b48-adf2-07573c5acabb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:58.458250 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5b2564d1-0c20-4b48-adf2-07573c5acabb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1262 microversion: 2.1 time: 0.091784 Jun 23 17:15:58.458820 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 267/534] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:58 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:59.104373 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b9cf36e6-e3c7-49e4-a5c1-71c0cc313729 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:59.105105 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b9cf36e6-e3c7-49e4-a5c1-71c0cc313729 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:59.111539 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9cf36e6-e3c7-49e4-a5c1-71c0cc313729 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:59.111986 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9cf36e6-e3c7-49e4-a5c1-71c0cc313729 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:59.112739 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9cf36e6-e3c7-49e4-a5c1-71c0cc313729 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:59.113199 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9cf36e6-e3c7-49e4-a5c1-71c0cc313729 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:59.262339 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b9cf36e6-e3c7-49e4-a5c1-71c0cc313729 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:59.270250 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b9cf36e6-e3c7-49e4-a5c1-71c0cc313729 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.169808 Jun 23 17:15:59.270819 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 268/535] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:59 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:59.443407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-226234b0-64df-41ef-bed1-e197a2a434b7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:59.444299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-226234b0-64df-41ef-bed1-e197a2a434b7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:59.456625 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-226234b0-64df-41ef-bed1-e197a2a434b7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:59.457493 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-226234b0-64df-41ef-bed1-e197a2a434b7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:59.458148 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-226234b0-64df-41ef-bed1-e197a2a434b7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:59.458585 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-226234b0-64df-41ef-bed1-e197a2a434b7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:59.475526 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-25920f69-0218-41ab-97c7-7efa88b0ba8c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:15:59.476215 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-25920f69-0218-41ab-97c7-7efa88b0ba8c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:15:59.483057 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-25920f69-0218-41ab-97c7-7efa88b0ba8c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:59.483512 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-25920f69-0218-41ab-97c7-7efa88b0ba8c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:59.484271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-25920f69-0218-41ab-97c7-7efa88b0ba8c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:15:59.484700 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-25920f69-0218-41ab-97c7-7efa88b0ba8c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:15:59.549319 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-25920f69-0218-41ab-97c7-7efa88b0ba8c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:59.557405 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-25920f69-0218-41ab-97c7-7efa88b0ba8c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1262 microversion: 2.1 time: 0.086045 Jun 23 17:15:59.558078 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 269/536] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:59 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:15:59.599133 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-226234b0-64df-41ef-bed1-e197a2a434b7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:15:59.606980 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-226234b0-64df-41ef-bed1-e197a2a434b7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.170101 Jun 23 17:15:59.607557 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 268/537] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:15:59 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:00.289931 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-af77b49f-03a2-4346-8006-5759a62a9f3b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:00.290739 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-af77b49f-03a2-4346-8006-5759a62a9f3b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:00.303598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-af77b49f-03a2-4346-8006-5759a62a9f3b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:00.303598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-af77b49f-03a2-4346-8006-5759a62a9f3b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:00.303598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-af77b49f-03a2-4346-8006-5759a62a9f3b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:00.303598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-af77b49f-03a2-4346-8006-5759a62a9f3b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:00.446356 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-af77b49f-03a2-4346-8006-5759a62a9f3b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:00.454168 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-af77b49f-03a2-4346-8006-5759a62a9f3b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.170521 Jun 23 17:16:00.454732 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 270/538] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:00 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:00.577061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ca73336d-40d2-424a-9aaf-41beb261dfd4 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:00.577842 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ca73336d-40d2-424a-9aaf-41beb261dfd4 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:00.586672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca73336d-40d2-424a-9aaf-41beb261dfd4 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:00.587119 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca73336d-40d2-424a-9aaf-41beb261dfd4 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:00.587892 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca73336d-40d2-424a-9aaf-41beb261dfd4 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:00.588323 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca73336d-40d2-424a-9aaf-41beb261dfd4 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:00.624511 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-afb34284-66d2-4957-abae-a2ff9b5b56fe tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:00.625769 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-afb34284-66d2-4957-abae-a2ff9b5b56fe tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:00.636708 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-afb34284-66d2-4957-abae-a2ff9b5b56fe tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:00.637153 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-afb34284-66d2-4957-abae-a2ff9b5b56fe tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:00.637956 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-afb34284-66d2-4957-abae-a2ff9b5b56fe tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:00.638389 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-afb34284-66d2-4957-abae-a2ff9b5b56fe tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:00.661105 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ca73336d-40d2-424a-9aaf-41beb261dfd4 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:00.669123 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ca73336d-40d2-424a-9aaf-41beb261dfd4 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1262 microversion: 2.1 time: 0.097383 Jun 23 17:16:00.669695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 269/539] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:00 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1262 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:00.802493 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-afb34284-66d2-4957-abae-a2ff9b5b56fe tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:00.823928 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-afb34284-66d2-4957-abae-a2ff9b5b56fe tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.203536 Jun 23 17:16:00.824810 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 271/540] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:00 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:01.471244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-72422778-24f3-4683-8c29-cc6aab9e24f1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:01.471931 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-72422778-24f3-4683-8c29-cc6aab9e24f1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:01.478597 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-72422778-24f3-4683-8c29-cc6aab9e24f1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:01.479173 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-72422778-24f3-4683-8c29-cc6aab9e24f1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:01.480008 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-72422778-24f3-4683-8c29-cc6aab9e24f1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:01.480508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-72422778-24f3-4683-8c29-cc6aab9e24f1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:01.694920 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9fbb0642-c8f0-47ba-aaf5-c82cdc5e3816 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:01.696639 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9fbb0642-c8f0-47ba-aaf5-c82cdc5e3816 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:01.705209 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9fbb0642-c8f0-47ba-aaf5-c82cdc5e3816 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:01.707150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9fbb0642-c8f0-47ba-aaf5-c82cdc5e3816 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:01.708162 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9fbb0642-c8f0-47ba-aaf5-c82cdc5e3816 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:01.708807 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9fbb0642-c8f0-47ba-aaf5-c82cdc5e3816 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:01.714324 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-72422778-24f3-4683-8c29-cc6aab9e24f1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:01.725247 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-72422778-24f3-4683-8c29-cc6aab9e24f1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.258482 Jun 23 17:16:01.726631 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 270/541] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:01 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:01.821511 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9fbb0642-c8f0-47ba-aaf5-c82cdc5e3816 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:01.831359 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9fbb0642-c8f0-47ba-aaf5-c82cdc5e3816 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1316 microversion: 2.1 time: 0.144419 Jun 23 17:16:01.832122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 272/542] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:01 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:01.840702 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f5e52b85-a7bf-4bc0-8c38-24315a5c02a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:01.841311 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f5e52b85-a7bf-4bc0-8c38-24315a5c02a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:01.847813 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f5e52b85-a7bf-4bc0-8c38-24315a5c02a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:01.848342 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f5e52b85-a7bf-4bc0-8c38-24315a5c02a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:01.849169 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f5e52b85-a7bf-4bc0-8c38-24315a5c02a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:01.849726 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f5e52b85-a7bf-4bc0-8c38-24315a5c02a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:01.876393 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:02.005436 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f5e52b85-a7bf-4bc0-8c38-24315a5c02a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:02.015202 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f5e52b85-a7bf-4bc0-8c38-24315a5c02a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.178380 Jun 23 17:16:02.016242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 271/543] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:01 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:02.742659 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-aa840fa4-99ea-4b93-b7a7-938cd208262d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:02.743416 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-aa840fa4-99ea-4b93-b7a7-938cd208262d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:02.750230 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aa840fa4-99ea-4b93-b7a7-938cd208262d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:02.750923 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aa840fa4-99ea-4b93-b7a7-938cd208262d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:02.751699 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aa840fa4-99ea-4b93-b7a7-938cd208262d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:02.752124 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aa840fa4-99ea-4b93-b7a7-938cd208262d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:02.857401 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-86aed58c-03a9-473d-b75b-e34627afc61c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:02.858710 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-86aed58c-03a9-473d-b75b-e34627afc61c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:02.866409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-86aed58c-03a9-473d-b75b-e34627afc61c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:02.867128 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-86aed58c-03a9-473d-b75b-e34627afc61c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:02.868078 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-86aed58c-03a9-473d-b75b-e34627afc61c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:02.868664 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-86aed58c-03a9-473d-b75b-e34627afc61c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:02.957535 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-aa840fa4-99ea-4b93-b7a7-938cd208262d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:02.965573 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-aa840fa4-99ea-4b93-b7a7-938cd208262d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.226810 Jun 23 17:16:02.966201 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 273/544] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:02 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:03.035186 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e7a90653-d787-49ad-b7cc-2eebc5629245 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:03.036035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e7a90653-d787-49ad-b7cc-2eebc5629245 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:03.049743 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7a90653-d787-49ad-b7cc-2eebc5629245 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:03.053866 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7a90653-d787-49ad-b7cc-2eebc5629245 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:03.055151 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7a90653-d787-49ad-b7cc-2eebc5629245 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:03.055775 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7a90653-d787-49ad-b7cc-2eebc5629245 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:03.232973 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e7a90653-d787-49ad-b7cc-2eebc5629245 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:03.234754 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-86aed58c-03a9-473d-b75b-e34627afc61c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:03.241960 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e7a90653-d787-49ad-b7cc-2eebc5629245 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.212336 Jun 23 17:16:03.242834 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 274/545] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:03 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:16:03.242969 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-86aed58c-03a9-473d-b75b-e34627afc61c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.395285 Jun 23 17:16:03.243503 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 272/546] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:02 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:16:03.982908 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f6ddc4d4-ad21-4f4c-9e1d-3579f55399f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:03.983450 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f6ddc4d4-ad21-4f4c-9e1d-3579f55399f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:03.990999 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6ddc4d4-ad21-4f4c-9e1d-3579f55399f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:03.991490 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6ddc4d4-ad21-4f4c-9e1d-3579f55399f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:03.992267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6ddc4d4-ad21-4f4c-9e1d-3579f55399f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:03.992710 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6ddc4d4-ad21-4f4c-9e1d-3579f55399f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:04.132350 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f6ddc4d4-ad21-4f4c-9e1d-3579f55399f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:04.140029 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f6ddc4d4-ad21-4f4c-9e1d-3579f55399f8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.161098 Jun 23 17:16:04.140594 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 275/547] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:03 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:04.259941 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-12bb43b2-2ef9-4a60-981c-67fcc7d8f8b5 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:04.260184 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e6d5ada8-5e6e-423f-906d-c1423de6043d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:04.260636 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-12bb43b2-2ef9-4a60-981c-67fcc7d8f8b5 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:04.260750 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e6d5ada8-5e6e-423f-906d-c1423de6043d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:04.262721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:04.267014 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-12bb43b2-2ef9-4a60-981c-67fcc7d8f8b5 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:04.267457 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-12bb43b2-2ef9-4a60-981c-67fcc7d8f8b5 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:04.268162 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e6d5ada8-5e6e-423f-906d-c1423de6043d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:04.268266 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-12bb43b2-2ef9-4a60-981c-67fcc7d8f8b5 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:04.268610 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e6d5ada8-5e6e-423f-906d-c1423de6043d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:04.268709 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-12bb43b2-2ef9-4a60-981c-67fcc7d8f8b5 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:04.269377 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e6d5ada8-5e6e-423f-906d-c1423de6043d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:04.269832 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e6d5ada8-5e6e-423f-906d-c1423de6043d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:04.426416 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e6d5ada8-5e6e-423f-906d-c1423de6043d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:04.430833 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-12bb43b2-2ef9-4a60-981c-67fcc7d8f8b5 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:04.434012 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e6d5ada8-5e6e-423f-906d-c1423de6043d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.178042 Jun 23 17:16:04.434942 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 273/548] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:04 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:04.438795 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-12bb43b2-2ef9-4a60-981c-67fcc7d8f8b5 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.182876 Jun 23 17:16:04.439435 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 276/549] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:04 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:05.158337 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-895534d5-a3b3-4a0e-ba33-d99a936f5e17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:05.159614 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-895534d5-a3b3-4a0e-ba33-d99a936f5e17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:05.169282 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-895534d5-a3b3-4a0e-ba33-d99a936f5e17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:05.170499 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-895534d5-a3b3-4a0e-ba33-d99a936f5e17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:05.171677 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-895534d5-a3b3-4a0e-ba33-d99a936f5e17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:05.172421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-895534d5-a3b3-4a0e-ba33-d99a936f5e17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:05.359830 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-859865b7-69f8-4d30-bac8-45451a39b254 req-0b82b1f3-c582-4166-af49-1661dd51c809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410f9789-fe14-436c-b928-5e32f1057008", "name": "network-vif-plugged", "status": "completed", "tag": "3cb62c73-34be-4c1e-ac1b-34d0ab60dbbf"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:05.364543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-895534d5-a3b3-4a0e-ba33-d99a936f5e17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:05.370576 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-859865b7-69f8-4d30-bac8-45451a39b254 req-0b82b1f3-c582-4166-af49-1661dd51c809 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:05.371639 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-859865b7-69f8-4d30-bac8-45451a39b254 req-0b82b1f3-c582-4166-af49-1661dd51c809 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:05.373340 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-895534d5-a3b3-4a0e-ba33-d99a936f5e17 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.220420 Jun 23 17:16:05.383876 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 274/550] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:05 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:05.411374 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-859865b7-69f8-4d30-bac8-45451a39b254 req-0b82b1f3-c582-4166-af49-1661dd51c809 service nova] Creating event network-vif-plugged:3cb62c73-34be-4c1e-ac1b-34d0ab60dbbf for instance 410f9789-fe14-436c-b928-5e32f1057008 on hv-cinder-83538 Jun 23 17:16:05.420617 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-859865b7-69f8-4d30-bac8-45451a39b254 req-0b82b1f3-c582-4166-af49-1661dd51c809 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064788 Jun 23 17:16:05.421620 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 277/551] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:16:05.451574 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-94145465-b6ce-49c0-8427-13d61c98ff2e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:05.452286 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-94145465-b6ce-49c0-8427-13d61c98ff2e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:05.455914 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6cbee1a3-84c5-41f3-a890-ef5d6e108ba2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:05.456655 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6cbee1a3-84c5-41f3-a890-ef5d6e108ba2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:05.458589 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-94145465-b6ce-49c0-8427-13d61c98ff2e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:05.459027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-94145465-b6ce-49c0-8427-13d61c98ff2e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:05.459774 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-94145465-b6ce-49c0-8427-13d61c98ff2e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:05.460196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-94145465-b6ce-49c0-8427-13d61c98ff2e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:05.463500 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6cbee1a3-84c5-41f3-a890-ef5d6e108ba2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:05.463945 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6cbee1a3-84c5-41f3-a890-ef5d6e108ba2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:05.464702 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6cbee1a3-84c5-41f3-a890-ef5d6e108ba2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:05.465134 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6cbee1a3-84c5-41f3-a890-ef5d6e108ba2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:05.607107 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6cbee1a3-84c5-41f3-a890-ef5d6e108ba2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:05.617967 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6cbee1a3-84c5-41f3-a890-ef5d6e108ba2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.166031 Jun 23 17:16:05.627343 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-94145465-b6ce-49c0-8427-13d61c98ff2e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:05.627649 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 278/552] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:05 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:16:05.636494 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-94145465-b6ce-49c0-8427-13d61c98ff2e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.188698 Jun 23 17:16:05.637050 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 275/553] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:05 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:06.395116 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-84a44ac3-c30b-4fd0-88dd-0cecf248c5ae tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:06.396047 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-84a44ac3-c30b-4fd0-88dd-0cecf248c5ae tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:06.407723 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84a44ac3-c30b-4fd0-88dd-0cecf248c5ae tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:06.408539 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84a44ac3-c30b-4fd0-88dd-0cecf248c5ae tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:06.410008 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84a44ac3-c30b-4fd0-88dd-0cecf248c5ae tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:06.410674 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84a44ac3-c30b-4fd0-88dd-0cecf248c5ae tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:06.611557 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-84a44ac3-c30b-4fd0-88dd-0cecf248c5ae tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:06.619368 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-84a44ac3-c30b-4fd0-88dd-0cecf248c5ae tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.230977 Jun 23 17:16:06.619903 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 279/554] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:06 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:06.635566 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d8095f24-4c39-4e5c-b31d-6a5cb7d98b28 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:06.636208 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d8095f24-4c39-4e5c-b31d-6a5cb7d98b28 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:06.642429 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d8095f24-4c39-4e5c-b31d-6a5cb7d98b28 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:06.642866 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d8095f24-4c39-4e5c-b31d-6a5cb7d98b28 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:06.643651 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d8095f24-4c39-4e5c-b31d-6a5cb7d98b28 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:06.644206 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d8095f24-4c39-4e5c-b31d-6a5cb7d98b28 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:06.655491 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b2b27cff-8f00-471e-a049-0c90a2961586 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:06.660022 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b2b27cff-8f00-471e-a049-0c90a2961586 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:06.666732 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b2b27cff-8f00-471e-a049-0c90a2961586 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:06.667296 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b2b27cff-8f00-471e-a049-0c90a2961586 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:06.668068 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b2b27cff-8f00-471e-a049-0c90a2961586 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:06.668649 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b2b27cff-8f00-471e-a049-0c90a2961586 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:06.789132 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d8095f24-4c39-4e5c-b31d-6a5cb7d98b28 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:06.797547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d8095f24-4c39-4e5c-b31d-6a5cb7d98b28 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.166383 Jun 23 17:16:06.810010 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 276/555] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:06 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:06.834460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b2b27cff-8f00-471e-a049-0c90a2961586 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:06.842395 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b2b27cff-8f00-471e-a049-0c90a2961586 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.191512 Jun 23 17:16:06.843355 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 280/556] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:06 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:07.638661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-18cfbea5-5f42-41cc-90ce-4422218a8a54 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:07.639417 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-18cfbea5-5f42-41cc-90ce-4422218a8a54 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:07.641555 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=4 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:07.642671 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=18 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:07.649342 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-18cfbea5-5f42-41cc-90ce-4422218a8a54 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:07.649784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-18cfbea5-5f42-41cc-90ce-4422218a8a54 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:07.650578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-18cfbea5-5f42-41cc-90ce-4422218a8a54 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:07.651039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-18cfbea5-5f42-41cc-90ce-4422218a8a54 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:07.808109 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-18cfbea5-5f42-41cc-90ce-4422218a8a54 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:07.816145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-18cfbea5-5f42-41cc-90ce-4422218a8a54 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.182438 Jun 23 17:16:07.816352 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-58eb4914-6719-4b90-9878-c0b2ba0de2b2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:07.817009 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 277/557] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:07 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:07.823420 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-58eb4914-6719-4b90-9878-c0b2ba0de2b2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:07.827242 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=14 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:07.828622 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:07.833403 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-58eb4914-6719-4b90-9878-c0b2ba0de2b2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:07.833899 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-58eb4914-6719-4b90-9878-c0b2ba0de2b2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:07.834753 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-58eb4914-6719-4b90-9878-c0b2ba0de2b2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:07.835157 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-58eb4914-6719-4b90-9878-c0b2ba0de2b2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:07.858765 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e0ff0263-0b10-4651-ab7b-4420c191e8fa tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:07.859534 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e0ff0263-0b10-4651-ab7b-4420c191e8fa tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:07.865827 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e0ff0263-0b10-4651-ab7b-4420c191e8fa tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:07.866406 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e0ff0263-0b10-4651-ab7b-4420c191e8fa tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:07.867277 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e0ff0263-0b10-4651-ab7b-4420c191e8fa tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:07.867817 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e0ff0263-0b10-4651-ab7b-4420c191e8fa tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:08.013464 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e0ff0263-0b10-4651-ab7b-4420c191e8fa tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:08.016953 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-58eb4914-6719-4b90-9878-c0b2ba0de2b2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:08.019236 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:08.021422 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e0ff0263-0b10-4651-ab7b-4420c191e8fa tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.166538 Jun 23 17:16:08.022022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 278/558] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:07 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:08.025856 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-58eb4914-6719-4b90-9878-c0b2ba0de2b2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.213813 Jun 23 17:16:08.026555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 281/559] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:07 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:08.835081 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-eb0e7ef3-f8b1-40bd-a3e5-23c5e7f6a429 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:08.835748 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-eb0e7ef3-f8b1-40bd-a3e5-23c5e7f6a429 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:08.842395 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eb0e7ef3-f8b1-40bd-a3e5-23c5e7f6a429 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:08.842879 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eb0e7ef3-f8b1-40bd-a3e5-23c5e7f6a429 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:08.843637 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eb0e7ef3-f8b1-40bd-a3e5-23c5e7f6a429 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:08.844074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eb0e7ef3-f8b1-40bd-a3e5-23c5e7f6a429 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:08.999024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-eb0e7ef3-f8b1-40bd-a3e5-23c5e7f6a429 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:09.015687 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-eb0e7ef3-f8b1-40bd-a3e5-23c5e7f6a429 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.184525 Jun 23 17:16:09.016650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 279/560] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:08 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:16:09.039128 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-348b5363-fe68-44fc-bd7f-c672bda57654 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:09.039744 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-348b5363-fe68-44fc-bd7f-c672bda57654 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:09.041639 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9372147a-1685-41a6-ba2d-1e76621f7eee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:09.042837 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9372147a-1685-41a6-ba2d-1e76621f7eee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:09.046270 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-348b5363-fe68-44fc-bd7f-c672bda57654 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:09.046723 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-348b5363-fe68-44fc-bd7f-c672bda57654 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:09.047486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-348b5363-fe68-44fc-bd7f-c672bda57654 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:09.047919 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-348b5363-fe68-44fc-bd7f-c672bda57654 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:09.048551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9372147a-1685-41a6-ba2d-1e76621f7eee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:09.048998 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9372147a-1685-41a6-ba2d-1e76621f7eee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:09.049761 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9372147a-1685-41a6-ba2d-1e76621f7eee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:09.050318 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9372147a-1685-41a6-ba2d-1e76621f7eee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:09.221557 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9372147a-1685-41a6-ba2d-1e76621f7eee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:09.232692 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9372147a-1685-41a6-ba2d-1e76621f7eee tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.194400 Jun 23 17:16:09.233999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 280/561] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:09 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:16:09.249525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-348b5363-fe68-44fc-bd7f-c672bda57654 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:09.257878 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-348b5363-fe68-44fc-bd7f-c672bda57654 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.222627 Jun 23 17:16:09.258421 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 282/562] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:09 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:10.032705 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7772c4ff-2f20-457e-8161-91c850b1810b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:10.034445 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7772c4ff-2f20-457e-8161-91c850b1810b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:10.041105 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7772c4ff-2f20-457e-8161-91c850b1810b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:10.041626 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7772c4ff-2f20-457e-8161-91c850b1810b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:10.042482 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7772c4ff-2f20-457e-8161-91c850b1810b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:10.042981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7772c4ff-2f20-457e-8161-91c850b1810b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:10.186412 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7772c4ff-2f20-457e-8161-91c850b1810b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:10.201015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7772c4ff-2f20-457e-8161-91c850b1810b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.167338 Jun 23 17:16:10.201015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 281/563] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:10 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:10.255159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8f2b9281-b554-4e2a-b561-e955ab5b25c6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:10.255869 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8f2b9281-b554-4e2a-b561-e955ab5b25c6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:10.262421 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8f2b9281-b554-4e2a-b561-e955ab5b25c6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:10.262854 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8f2b9281-b554-4e2a-b561-e955ab5b25c6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:10.263653 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8f2b9281-b554-4e2a-b561-e955ab5b25c6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:10.264074 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8f2b9281-b554-4e2a-b561-e955ab5b25c6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:10.273818 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4c9fc6f0-5d8e-4518-b03e-94a48745a1fb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:10.274439 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4c9fc6f0-5d8e-4518-b03e-94a48745a1fb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:10.280746 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4c9fc6f0-5d8e-4518-b03e-94a48745a1fb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:10.281192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4c9fc6f0-5d8e-4518-b03e-94a48745a1fb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:10.281984 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4c9fc6f0-5d8e-4518-b03e-94a48745a1fb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:10.282458 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4c9fc6f0-5d8e-4518-b03e-94a48745a1fb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:10.409354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8f2b9281-b554-4e2a-b561-e955ab5b25c6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:10.419876 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8f2b9281-b554-4e2a-b561-e955ab5b25c6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.168406 Jun 23 17:16:10.425561 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 283/564] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:10 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:10.446337 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4c9fc6f0-5d8e-4518-b03e-94a48745a1fb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:10.455155 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4c9fc6f0-5d8e-4518-b03e-94a48745a1fb tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.185116 Jun 23 17:16:10.457834 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 282/565] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:10 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:16:11.213009 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ba430b3b-5829-4c1b-9694-25d1de913a33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:11.213622 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ba430b3b-5829-4c1b-9694-25d1de913a33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:11.220352 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ba430b3b-5829-4c1b-9694-25d1de913a33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:11.220808 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ba430b3b-5829-4c1b-9694-25d1de913a33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:11.221590 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ba430b3b-5829-4c1b-9694-25d1de913a33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:11.222137 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ba430b3b-5829-4c1b-9694-25d1de913a33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:11.360236 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ba430b3b-5829-4c1b-9694-25d1de913a33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:11.373606 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ba430b3b-5829-4c1b-9694-25d1de913a33 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.163850 Jun 23 17:16:11.374917 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 284/566] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:11 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:11.436774 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-930a3ae2-5832-4eb1-8bc3-eabbfd7e5da8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:11.437953 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-930a3ae2-5832-4eb1-8bc3-eabbfd7e5da8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:11.444153 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-930a3ae2-5832-4eb1-8bc3-eabbfd7e5da8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:11.444604 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-930a3ae2-5832-4eb1-8bc3-eabbfd7e5da8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:11.445364 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-930a3ae2-5832-4eb1-8bc3-eabbfd7e5da8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:11.445822 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-930a3ae2-5832-4eb1-8bc3-eabbfd7e5da8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:11.472265 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-541834eb-4716-49ac-9136-1e525d3c88d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:11.472682 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-541834eb-4716-49ac-9136-1e525d3c88d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:11.479456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-541834eb-4716-49ac-9136-1e525d3c88d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:11.479909 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-541834eb-4716-49ac-9136-1e525d3c88d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:11.480680 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-541834eb-4716-49ac-9136-1e525d3c88d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:11.481110 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-541834eb-4716-49ac-9136-1e525d3c88d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:11.588639 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-930a3ae2-5832-4eb1-8bc3-eabbfd7e5da8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:11.597420 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-930a3ae2-5832-4eb1-8bc3-eabbfd7e5da8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.164956 Jun 23 17:16:11.598098 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 283/567] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:11 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:11.643261 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-541834eb-4716-49ac-9136-1e525d3c88d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:11.651959 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-541834eb-4716-49ac-9136-1e525d3c88d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.183892 Jun 23 17:16:11.652745 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 285/568] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:11 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:12.393059 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-699a64a6-9b5c-4bc9-a502-b3c297e7cd87 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:12.393675 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-699a64a6-9b5c-4bc9-a502-b3c297e7cd87 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:12.400504 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-699a64a6-9b5c-4bc9-a502-b3c297e7cd87 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:12.400942 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-699a64a6-9b5c-4bc9-a502-b3c297e7cd87 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:12.401737 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-699a64a6-9b5c-4bc9-a502-b3c297e7cd87 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:12.402205 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-699a64a6-9b5c-4bc9-a502-b3c297e7cd87 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:12.543037 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-699a64a6-9b5c-4bc9-a502-b3c297e7cd87 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:12.551922 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-699a64a6-9b5c-4bc9-a502-b3c297e7cd87 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.163104 Jun 23 17:16:12.552471 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 284/569] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:12 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:12.616781 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-949c42e7-534b-406a-a2a3-cb22e9df99f9 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:12.617603 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-949c42e7-534b-406a-a2a3-cb22e9df99f9 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:12.627458 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-949c42e7-534b-406a-a2a3-cb22e9df99f9 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:12.628096 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-949c42e7-534b-406a-a2a3-cb22e9df99f9 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:12.629171 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-949c42e7-534b-406a-a2a3-cb22e9df99f9 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:12.629786 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-949c42e7-534b-406a-a2a3-cb22e9df99f9 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:12.670749 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6be64e54-c0ee-43de-91be-e09cb258379a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:12.671755 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6be64e54-c0ee-43de-91be-e09cb258379a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:12.693432 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6be64e54-c0ee-43de-91be-e09cb258379a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:12.695463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6be64e54-c0ee-43de-91be-e09cb258379a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:12.696686 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6be64e54-c0ee-43de-91be-e09cb258379a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:12.697273 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6be64e54-c0ee-43de-91be-e09cb258379a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:12.780093 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-949c42e7-534b-406a-a2a3-cb22e9df99f9 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:12.787917 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-949c42e7-534b-406a-a2a3-cb22e9df99f9 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.176678 Jun 23 17:16:12.789369 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 286/570] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:12 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:12.844967 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6be64e54-c0ee-43de-91be-e09cb258379a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:12.852572 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6be64e54-c0ee-43de-91be-e09cb258379a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.187849 Jun 23 17:16:12.853147 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 285/571] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:12 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:13.571889 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a89b771f-2c9a-46ba-a746-ffd6b9f135aa tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:13.572984 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a89b771f-2c9a-46ba-a746-ffd6b9f135aa tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:13.582649 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a89b771f-2c9a-46ba-a746-ffd6b9f135aa tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:13.583105 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a89b771f-2c9a-46ba-a746-ffd6b9f135aa tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:13.583884 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a89b771f-2c9a-46ba-a746-ffd6b9f135aa tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:13.584326 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a89b771f-2c9a-46ba-a746-ffd6b9f135aa tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:13.724188 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a89b771f-2c9a-46ba-a746-ffd6b9f135aa tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:13.734756 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a89b771f-2c9a-46ba-a746-ffd6b9f135aa tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.169495 Jun 23 17:16:13.735546 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 287/572] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:13 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:13.807336 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-eb04f6f1-50b4-4e24-80bb-3e8d657cf5b0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:13.807930 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-eb04f6f1-50b4-4e24-80bb-3e8d657cf5b0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:13.814935 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eb04f6f1-50b4-4e24-80bb-3e8d657cf5b0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:13.815383 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eb04f6f1-50b4-4e24-80bb-3e8d657cf5b0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:13.816139 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eb04f6f1-50b4-4e24-80bb-3e8d657cf5b0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:13.816570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eb04f6f1-50b4-4e24-80bb-3e8d657cf5b0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:13.871498 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-09aef1c5-62ef-413d-9e5c-8d8d94caf664 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:13.872692 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-09aef1c5-62ef-413d-9e5c-8d8d94caf664 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:13.880372 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-09aef1c5-62ef-413d-9e5c-8d8d94caf664 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:13.881902 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-09aef1c5-62ef-413d-9e5c-8d8d94caf664 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:13.884143 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-09aef1c5-62ef-413d-9e5c-8d8d94caf664 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:13.884771 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-09aef1c5-62ef-413d-9e5c-8d8d94caf664 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:13.959543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-eb04f6f1-50b4-4e24-80bb-3e8d657cf5b0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:13.967658 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-eb04f6f1-50b4-4e24-80bb-3e8d657cf5b0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.165657 Jun 23 17:16:13.968402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 286/573] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:13 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:14.019583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-09aef1c5-62ef-413d-9e5c-8d8d94caf664 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:14.029424 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-09aef1c5-62ef-413d-9e5c-8d8d94caf664 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.162327 Jun 23 17:16:14.030324 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 288/574] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:13 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:14.755297 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-df655771-8311-4c13-bef3-84610dc75e9a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:14.755556 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-df655771-8311-4c13-bef3-84610dc75e9a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:14.763892 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-df655771-8311-4c13-bef3-84610dc75e9a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:14.764344 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-df655771-8311-4c13-bef3-84610dc75e9a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:14.765640 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-df655771-8311-4c13-bef3-84610dc75e9a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:14.765640 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-df655771-8311-4c13-bef3-84610dc75e9a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:14.902685 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-df655771-8311-4c13-bef3-84610dc75e9a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:14.910655 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-df655771-8311-4c13-bef3-84610dc75e9a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.159660 Jun 23 17:16:14.911200 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 287/575] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:14 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:14.988566 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ef3577c0-ae68-4872-8799-7f03b3a99a21 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:14.989436 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ef3577c0-ae68-4872-8799-7f03b3a99a21 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:14.997843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef3577c0-ae68-4872-8799-7f03b3a99a21 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:14.998325 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef3577c0-ae68-4872-8799-7f03b3a99a21 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:14.999087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef3577c0-ae68-4872-8799-7f03b3a99a21 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:14.999522 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef3577c0-ae68-4872-8799-7f03b3a99a21 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:15.047077 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-28874cf9-fdb3-4e1d-808c-54039cb36d4c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:15.047528 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-28874cf9-fdb3-4e1d-808c-54039cb36d4c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:15.053699 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-28874cf9-fdb3-4e1d-808c-54039cb36d4c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:15.054196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-28874cf9-fdb3-4e1d-808c-54039cb36d4c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:15.054928 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-28874cf9-fdb3-4e1d-808c-54039cb36d4c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:15.055362 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-28874cf9-fdb3-4e1d-808c-54039cb36d4c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:15.059403 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:15.079919 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-28874cf9-fdb3-4e1d-808c-54039cb36d4c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/ips" status: 200 len: 149 microversion: 2.1 time: 0.036748 Jun 23 17:16:15.080508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 288/576] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 23 17:16:15 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:15.085885 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d2408816-741c-4e00-8a18-573e83777bed tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:15.085885 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d2408816-741c-4e00-8a18-573e83777bed tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:15.094401 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d2408816-741c-4e00-8a18-573e83777bed tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:15.094849 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d2408816-741c-4e00-8a18-573e83777bed tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:15.095596 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d2408816-741c-4e00-8a18-573e83777bed tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:15.096102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d2408816-741c-4e00-8a18-573e83777bed tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:15.142666 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ef3577c0-ae68-4872-8799-7f03b3a99a21 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:15.150223 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ef3577c0-ae68-4872-8799-7f03b3a99a21 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.168319 Jun 23 17:16:15.151086 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 289/577] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:14 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:15.231651 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d2408816-741c-4e00-8a18-573e83777bed tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:15.239466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d2408816-741c-4e00-8a18-573e83777bed tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.157926 Jun 23 17:16:15.240048 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 289/578] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:15 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:15.932234 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c2827be6-2064-410a-b2d1-f79631aaf703 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:15.932989 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c2827be6-2064-410a-b2d1-f79631aaf703 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:15.941365 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c2827be6-2064-410a-b2d1-f79631aaf703 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:15.941984 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c2827be6-2064-410a-b2d1-f79631aaf703 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:15.943008 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c2827be6-2064-410a-b2d1-f79631aaf703 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:15.943468 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c2827be6-2064-410a-b2d1-f79631aaf703 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:16.076958 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c2827be6-2064-410a-b2d1-f79631aaf703 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:16.088177 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c2827be6-2064-410a-b2d1-f79631aaf703 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.162528 Jun 23 17:16:16.088774 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 290/579] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:15 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:16.170922 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fa010728-6ff6-4d13-a822-956fe9f22cfb tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:16.171852 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fa010728-6ff6-4d13-a822-956fe9f22cfb tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:16.182520 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fa010728-6ff6-4d13-a822-956fe9f22cfb tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:16.183277 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fa010728-6ff6-4d13-a822-956fe9f22cfb tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:16.184924 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fa010728-6ff6-4d13-a822-956fe9f22cfb tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:16.185646 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fa010728-6ff6-4d13-a822-956fe9f22cfb tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:16.258681 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c4c87d03-4674-41c5-a4f3-d449128187b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:16.259218 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c4c87d03-4674-41c5-a4f3-d449128187b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:16.265423 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c4c87d03-4674-41c5-a4f3-d449128187b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:16.265898 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c4c87d03-4674-41c5-a4f3-d449128187b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:16.266665 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c4c87d03-4674-41c5-a4f3-d449128187b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:16.267094 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c4c87d03-4674-41c5-a4f3-d449128187b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:16.330035 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-fa010728-6ff6-4d13-a822-956fe9f22cfb tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:16.337876 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-fa010728-6ff6-4d13-a822-956fe9f22cfb tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.173631 Jun 23 17:16:16.338450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 290/580] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:16 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:16.400039 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c4c87d03-4674-41c5-a4f3-d449128187b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:16.407948 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c4c87d03-4674-41c5-a4f3-d449128187b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.153414 Jun 23 17:16:16.408798 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 291/581] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:16 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:16:17.109720 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ca84f410-876d-435c-a383-c5c0076c52ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:17.110754 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ca84f410-876d-435c-a383-c5c0076c52ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:17.121013 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca84f410-876d-435c-a383-c5c0076c52ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:17.121745 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca84f410-876d-435c-a383-c5c0076c52ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:17.123098 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca84f410-876d-435c-a383-c5c0076c52ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:17.123799 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ca84f410-876d-435c-a383-c5c0076c52ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:17.267975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ca84f410-876d-435c-a383-c5c0076c52ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:17.278429 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ca84f410-876d-435c-a383-c5c0076c52ab tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.175136 Jun 23 17:16:17.278993 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 291/582] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:17 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:17.358750 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2c6ae749-683f-499d-b9ef-5acad33e2b68 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:17.359843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2c6ae749-683f-499d-b9ef-5acad33e2b68 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:17.369625 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2c6ae749-683f-499d-b9ef-5acad33e2b68 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:17.370100 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2c6ae749-683f-499d-b9ef-5acad33e2b68 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:17.370845 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2c6ae749-683f-499d-b9ef-5acad33e2b68 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:17.371269 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2c6ae749-683f-499d-b9ef-5acad33e2b68 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:17.424617 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a382d5e9-d8dd-491e-b236-7886ae3cca79 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:17.425217 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a382d5e9-d8dd-491e-b236-7886ae3cca79 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:17.431796 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a382d5e9-d8dd-491e-b236-7886ae3cca79 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:17.432235 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a382d5e9-d8dd-491e-b236-7886ae3cca79 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:17.432986 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a382d5e9-d8dd-491e-b236-7886ae3cca79 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:17.433575 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a382d5e9-d8dd-491e-b236-7886ae3cca79 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:17.505287 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2c6ae749-683f-499d-b9ef-5acad33e2b68 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:17.512892 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2c6ae749-683f-499d-b9ef-5acad33e2b68 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.160698 Jun 23 17:16:17.513457 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 292/583] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:17 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:17.518180 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2d3b969b-5d61-4282-be67-6a04cbf8cb8e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32efacb9-dbee-426c-83c8-50a630dc2d8e"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:17.519298 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2d3b969b-5d61-4282-be67-6a04cbf8cb8e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:17.525661 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d3b969b-5d61-4282-be67-6a04cbf8cb8e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:17.526127 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d3b969b-5d61-4282-be67-6a04cbf8cb8e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:17.526881 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d3b969b-5d61-4282-be67-6a04cbf8cb8e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:17.527307 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d3b969b-5d61-4282-be67-6a04cbf8cb8e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:17.571594 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a382d5e9-d8dd-491e-b236-7886ae3cca79 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:17.580768 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a382d5e9-d8dd-491e-b236-7886ae3cca79 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.160008 Jun 23 17:16:17.581618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 292/584] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:17 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:18.299896 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1fce09a6-4a16-44d1-b87e-ec596ebde866 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:18.300960 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1fce09a6-4a16-44d1-b87e-ec596ebde866 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:18.309889 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1fce09a6-4a16-44d1-b87e-ec596ebde866 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:18.310284 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1fce09a6-4a16-44d1-b87e-ec596ebde866 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:18.311033 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1fce09a6-4a16-44d1-b87e-ec596ebde866 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:18.311456 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1fce09a6-4a16-44d1-b87e-ec596ebde866 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:18.447453 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1fce09a6-4a16-44d1-b87e-ec596ebde866 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:18.455535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1fce09a6-4a16-44d1-b87e-ec596ebde866 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.162169 Jun 23 17:16:18.456219 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 293/585] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:18 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:18.529411 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e6c65621-1db0-44fe-8103-dbcd0fee0c9a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:18.530037 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e6c65621-1db0-44fe-8103-dbcd0fee0c9a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:18.536386 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e6c65621-1db0-44fe-8103-dbcd0fee0c9a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:18.536831 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e6c65621-1db0-44fe-8103-dbcd0fee0c9a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:18.537579 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e6c65621-1db0-44fe-8103-dbcd0fee0c9a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:18.538047 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e6c65621-1db0-44fe-8103-dbcd0fee0c9a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:18.672987 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e6c65621-1db0-44fe-8103-dbcd0fee0c9a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:18.680762 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e6c65621-1db0-44fe-8103-dbcd0fee0c9a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.155199 Jun 23 17:16:18.681327 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 294/586] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:18 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:18.686160 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-647b7119-9fa4-4052-8e10-af0eb080170e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:18.686791 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-647b7119-9fa4-4052-8e10-af0eb080170e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:18.693070 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-647b7119-9fa4-4052-8e10-af0eb080170e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:18.693519 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-647b7119-9fa4-4052-8e10-af0eb080170e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:18.694311 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-647b7119-9fa4-4052-8e10-af0eb080170e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:18.694741 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-647b7119-9fa4-4052-8e10-af0eb080170e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:18.834634 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-647b7119-9fa4-4052-8e10-af0eb080170e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:18.843016 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-647b7119-9fa4-4052-8e10-af0eb080170e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.160757 Jun 23 17:16:18.843607 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 295/587] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:18 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:19.476711 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-783947ab-5c8f-4d13-99fd-a0c24f20242c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:19.477722 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-783947ab-5c8f-4d13-99fd-a0c24f20242c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:19.484211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-783947ab-5c8f-4d13-99fd-a0c24f20242c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:19.484686 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-783947ab-5c8f-4d13-99fd-a0c24f20242c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:19.485429 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-783947ab-5c8f-4d13-99fd-a0c24f20242c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:19.485882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-783947ab-5c8f-4d13-99fd-a0c24f20242c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:19.619558 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-783947ab-5c8f-4d13-99fd-a0c24f20242c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:19.627765 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-783947ab-5c8f-4d13-99fd-a0c24f20242c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.157578 Jun 23 17:16:19.628311 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 296/588] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:19 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:19.697474 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-92c64ed4-3474-4615-8320-f06374bbd803 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:19.698116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-92c64ed4-3474-4615-8320-f06374bbd803 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:19.705050 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-92c64ed4-3474-4615-8320-f06374bbd803 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:19.705501 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-92c64ed4-3474-4615-8320-f06374bbd803 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:19.706299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-92c64ed4-3474-4615-8320-f06374bbd803 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:19.706737 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-92c64ed4-3474-4615-8320-f06374bbd803 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:19.842379 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-92c64ed4-3474-4615-8320-f06374bbd803 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:19.850167 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-92c64ed4-3474-4615-8320-f06374bbd803 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.156651 Jun 23 17:16:19.850725 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 297/589] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:19 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:19.859669 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a91a77b7-8c1c-4dcf-8275-6ae90173c946 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:19.860266 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a91a77b7-8c1c-4dcf-8275-6ae90173c946 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:19.866609 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a91a77b7-8c1c-4dcf-8275-6ae90173c946 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:19.867047 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a91a77b7-8c1c-4dcf-8275-6ae90173c946 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:19.867790 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a91a77b7-8c1c-4dcf-8275-6ae90173c946 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:19.868274 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a91a77b7-8c1c-4dcf-8275-6ae90173c946 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:19.998879 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a91a77b7-8c1c-4dcf-8275-6ae90173c946 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:20.006480 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a91a77b7-8c1c-4dcf-8275-6ae90173c946 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.150453 Jun 23 17:16:20.007039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 298/590] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:19 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:16:20.648810 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c78f12b1-4395-489c-997e-ccefde2b42b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:20.649963 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c78f12b1-4395-489c-997e-ccefde2b42b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:20.660061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c78f12b1-4395-489c-997e-ccefde2b42b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:20.660803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c78f12b1-4395-489c-997e-ccefde2b42b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:20.662112 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c78f12b1-4395-489c-997e-ccefde2b42b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:20.662844 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c78f12b1-4395-489c-997e-ccefde2b42b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:20.797967 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c78f12b1-4395-489c-997e-ccefde2b42b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:20.806153 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c78f12b1-4395-489c-997e-ccefde2b42b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.163470 Jun 23 17:16:20.806748 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 299/591] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:20 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:20.870631 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a7034a08-107c-4675-a17b-5b3a502e74c3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:20.871610 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a7034a08-107c-4675-a17b-5b3a502e74c3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:20.881646 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a7034a08-107c-4675-a17b-5b3a502e74c3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:20.882437 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a7034a08-107c-4675-a17b-5b3a502e74c3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:20.883869 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a7034a08-107c-4675-a17b-5b3a502e74c3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:20.884321 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a7034a08-107c-4675-a17b-5b3a502e74c3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:21.027212 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a7034a08-107c-4675-a17b-5b3a502e74c3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:21.035312 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a7034a08-107c-4675-a17b-5b3a502e74c3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.170950 Jun 23 17:16:21.035872 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 300/592] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:20 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:21.040202 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-afa28f15-d1d8-4cb1-90f7-79ba87d08a6c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:21.040991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-afa28f15-d1d8-4cb1-90f7-79ba87d08a6c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:21.047038 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-afa28f15-d1d8-4cb1-90f7-79ba87d08a6c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:21.047477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-afa28f15-d1d8-4cb1-90f7-79ba87d08a6c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:21.048225 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-afa28f15-d1d8-4cb1-90f7-79ba87d08a6c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:21.048650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-afa28f15-d1d8-4cb1-90f7-79ba87d08a6c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:21.180789 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-afa28f15-d1d8-4cb1-90f7-79ba87d08a6c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:21.188769 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-afa28f15-d1d8-4cb1-90f7-79ba87d08a6c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.151968 Jun 23 17:16:21.189335 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 301/593] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:21 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:21.822815 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-632801ba-c79f-4128-a5eb-ed6185b7f389 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:21.823473 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-632801ba-c79f-4128-a5eb-ed6185b7f389 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:21.830581 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-632801ba-c79f-4128-a5eb-ed6185b7f389 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:21.831142 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-632801ba-c79f-4128-a5eb-ed6185b7f389 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:21.832185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-632801ba-c79f-4128-a5eb-ed6185b7f389 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:21.832810 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-632801ba-c79f-4128-a5eb-ed6185b7f389 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:21.982880 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-632801ba-c79f-4128-a5eb-ed6185b7f389 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:21.991002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-632801ba-c79f-4128-a5eb-ed6185b7f389 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.172150 Jun 23 17:16:21.991592 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 302/594] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:21 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:16:21.996524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-96220eec-e24c-4fb4-9564-d8250ed80754 req-28283bfd-cafb-4bb7-9f9c-90989582b196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80236cf3-b3a0-42de-89ee-da5deb3de2a1", "tag": "f326af8b-43a2-44c9-902a-68353086ffbf"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:22.004984 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-96220eec-e24c-4fb4-9564-d8250ed80754 req-28283bfd-cafb-4bb7-9f9c-90989582b196 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:22.005423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-96220eec-e24c-4fb4-9564-d8250ed80754 req-28283bfd-cafb-4bb7-9f9c-90989582b196 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:22.017153 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-96220eec-e24c-4fb4-9564-d8250ed80754 req-28283bfd-cafb-4bb7-9f9c-90989582b196 service nova] Creating event network-changed:f326af8b-43a2-44c9-902a-68353086ffbf for instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 on hv-cinder-83538 Jun 23 17:16:22.022163 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-96220eec-e24c-4fb4-9564-d8250ed80754 req-28283bfd-cafb-4bb7-9f9c-90989582b196 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029434 Jun 23 17:16:22.022971 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 303/595] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:22.052980 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1bca8a96-5fa7-48bc-b059-e2770a63bc57 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:22.053674 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1bca8a96-5fa7-48bc-b059-e2770a63bc57 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:22.060619 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1bca8a96-5fa7-48bc-b059-e2770a63bc57 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:22.061064 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1bca8a96-5fa7-48bc-b059-e2770a63bc57 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:22.061852 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1bca8a96-5fa7-48bc-b059-e2770a63bc57 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:22.062293 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1bca8a96-5fa7-48bc-b059-e2770a63bc57 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:22.205323 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1bca8a96-5fa7-48bc-b059-e2770a63bc57 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:22.214100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1bca8a96-5fa7-48bc-b059-e2770a63bc57 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.165388 Jun 23 17:16:22.214674 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 304/596] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:22 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:16:22.219168 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6e78bedc-3461-40e2-af78-afb5f32ee2d9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:22.219767 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6e78bedc-3461-40e2-af78-afb5f32ee2d9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:22.225869 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e78bedc-3461-40e2-af78-afb5f32ee2d9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:22.226314 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e78bedc-3461-40e2-af78-afb5f32ee2d9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:22.227065 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e78bedc-3461-40e2-af78-afb5f32ee2d9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:22.228129 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e78bedc-3461-40e2-af78-afb5f32ee2d9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:22.361743 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6e78bedc-3461-40e2-af78-afb5f32ee2d9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:22.365367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:22.370563 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6e78bedc-3461-40e2-af78-afb5f32ee2d9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.154922 Jun 23 17:16:22.371173 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 305/597] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:22 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:23.011785 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-209c189b-24dc-4f81-ad61-9c2aa8bd484e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:23.012526 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-209c189b-24dc-4f81-ad61-9c2aa8bd484e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:23.020157 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-209c189b-24dc-4f81-ad61-9c2aa8bd484e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:23.020680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-209c189b-24dc-4f81-ad61-9c2aa8bd484e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:23.021554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-209c189b-24dc-4f81-ad61-9c2aa8bd484e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:23.022100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-209c189b-24dc-4f81-ad61-9c2aa8bd484e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:23.161337 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-209c189b-24dc-4f81-ad61-9c2aa8bd484e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:23.172092 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-209c189b-24dc-4f81-ad61-9c2aa8bd484e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.166555 Jun 23 17:16:23.172766 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 306/598] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:23 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:23.231607 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6c34183a-82d7-474f-8f99-1fb67f1c5ae2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:23.232234 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6c34183a-82d7-474f-8f99-1fb67f1c5ae2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:23.238415 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6c34183a-82d7-474f-8f99-1fb67f1c5ae2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:23.238850 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6c34183a-82d7-474f-8f99-1fb67f1c5ae2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:23.239770 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6c34183a-82d7-474f-8f99-1fb67f1c5ae2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:23.240034 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6c34183a-82d7-474f-8f99-1fb67f1c5ae2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:23.405106 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2d3b969b-5d61-4282-be67-6a04cbf8cb8e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "POST /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.890314 Jun 23 17:16:23.407018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 293/599] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 23 17:16:17 2022] POST /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/os-volume_attachments => generated 194 bytes in 5893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:23.414218 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2c485eb1-3381-4d26-a1bf-93be8864538d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:23.415507 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2c485eb1-3381-4d26-a1bf-93be8864538d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:23.425473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2c485eb1-3381-4d26-a1bf-93be8864538d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:23.426301 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2c485eb1-3381-4d26-a1bf-93be8864538d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:23.427508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2c485eb1-3381-4d26-a1bf-93be8864538d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:23.428641 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2c485eb1-3381-4d26-a1bf-93be8864538d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:23.645437 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2c485eb1-3381-4d26-a1bf-93be8864538d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:23.646389 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6c34183a-82d7-474f-8f99-1fb67f1c5ae2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:23.653731 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2c485eb1-3381-4d26-a1bf-93be8864538d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.245107 Jun 23 17:16:23.654093 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6c34183a-82d7-474f-8f99-1fb67f1c5ae2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.427485 Jun 23 17:16:23.654613 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 294/600] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:23 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:23.654762 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 307/601] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:23 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:24.189305 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5321e770-5cff-4a09-ab7e-67394c751265 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:24.189985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5321e770-5cff-4a09-ab7e-67394c751265 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:24.196276 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5321e770-5cff-4a09-ab7e-67394c751265 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:24.196890 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5321e770-5cff-4a09-ab7e-67394c751265 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:24.197657 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5321e770-5cff-4a09-ab7e-67394c751265 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:24.198122 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5321e770-5cff-4a09-ab7e-67394c751265 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:24.438100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5321e770-5cff-4a09-ab7e-67394c751265 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:24.445887 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5321e770-5cff-4a09-ab7e-67394c751265 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.260560 Jun 23 17:16:24.446471 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 308/602] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:24 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:24.673777 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c69acc14-a66c-4508-b595-fd7f7801884a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:24.674590 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-467c51e7-c180-4424-a93f-e4726904dd04 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:24.674740 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c69acc14-a66c-4508-b595-fd7f7801884a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:24.674855 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-467c51e7-c180-4424-a93f-e4726904dd04 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:24.683667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-467c51e7-c180-4424-a93f-e4726904dd04 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:24.684569 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c69acc14-a66c-4508-b595-fd7f7801884a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:24.684803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-467c51e7-c180-4424-a93f-e4726904dd04 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:24.685201 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c69acc14-a66c-4508-b595-fd7f7801884a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:24.685718 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-467c51e7-c180-4424-a93f-e4726904dd04 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:24.686338 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c69acc14-a66c-4508-b595-fd7f7801884a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:24.686555 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-467c51e7-c180-4424-a93f-e4726904dd04 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:24.686920 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c69acc14-a66c-4508-b595-fd7f7801884a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:24.818069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-467c51e7-c180-4424-a93f-e4726904dd04 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:24.826148 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-467c51e7-c180-4424-a93f-e4726904dd04 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.157582 Jun 23 17:16:24.826757 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 309/603] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:24 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:24.832764 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c69acc14-a66c-4508-b595-fd7f7801884a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:24.841632 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c69acc14-a66c-4508-b595-fd7f7801884a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.173438 Jun 23 17:16:24.842244 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 295/604] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:24 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:25.463747 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-26f6559a-83a3-4c2d-95e3-51a7dc7ed4df tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:25.464387 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-26f6559a-83a3-4c2d-95e3-51a7dc7ed4df tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:25.470836 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-26f6559a-83a3-4c2d-95e3-51a7dc7ed4df tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:25.471290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-26f6559a-83a3-4c2d-95e3-51a7dc7ed4df tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:25.472051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-26f6559a-83a3-4c2d-95e3-51a7dc7ed4df tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:25.472477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-26f6559a-83a3-4c2d-95e3-51a7dc7ed4df tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:25.622161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-26f6559a-83a3-4c2d-95e3-51a7dc7ed4df tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:25.630783 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-26f6559a-83a3-4c2d-95e3-51a7dc7ed4df tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1371 microversion: 2.1 time: 0.171152 Jun 23 17:16:25.632096 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 310/605] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:25 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:25.852344 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-91eca39f-383e-4cba-bf20-c32d666c712e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:25.853392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-91eca39f-383e-4cba-bf20-c32d666c712e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:25.859039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-0ff72a0c-2248-45b9-bf1c-5115941e3a85 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:25.859742 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-0ff72a0c-2248-45b9-bf1c-5115941e3a85 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:25.860996 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-91eca39f-383e-4cba-bf20-c32d666c712e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:25.861758 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-91eca39f-383e-4cba-bf20-c32d666c712e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:25.862914 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-91eca39f-383e-4cba-bf20-c32d666c712e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:25.863293 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-91eca39f-383e-4cba-bf20-c32d666c712e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:25.866497 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0ff72a0c-2248-45b9-bf1c-5115941e3a85 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:25.866967 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0ff72a0c-2248-45b9-bf1c-5115941e3a85 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:25.867771 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0ff72a0c-2248-45b9-bf1c-5115941e3a85 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:25.868474 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0ff72a0c-2248-45b9-bf1c-5115941e3a85 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:26.008095 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-91eca39f-383e-4cba-bf20-c32d666c712e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:26.013092 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-0ff72a0c-2248-45b9-bf1c-5115941e3a85 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:26.015918 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-91eca39f-383e-4cba-bf20-c32d666c712e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.167591 Jun 23 17:16:26.017599 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 296/606] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:25 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:26.022433 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-0ff72a0c-2248-45b9-bf1c-5115941e3a85 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.167284 Jun 23 17:16:26.023378 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 311/607] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:25 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:26.025339 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-4d6ab568-3029-4fd0-b07a-7a732165f8ed req-b878f72e-4b50-4eda-a9e8-3ee30092d928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8f045dd-0ec4-4225-8bae-0035daa2c0ee", "name": "network-vif-plugged", "status": "completed", "tag": "5e0d8b7e-7e66-48e6-b53e-f85a41aeb721"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:26.034626 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-4d6ab568-3029-4fd0-b07a-7a732165f8ed req-b878f72e-4b50-4eda-a9e8-3ee30092d928 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:26.035070 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-4d6ab568-3029-4fd0-b07a-7a732165f8ed req-b878f72e-4b50-4eda-a9e8-3ee30092d928 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:26.039137 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:26.047171 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-4d6ab568-3029-4fd0-b07a-7a732165f8ed req-b878f72e-4b50-4eda-a9e8-3ee30092d928 service nova] Creating event network-vif-plugged:5e0d8b7e-7e66-48e6-b53e-f85a41aeb721 for instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee on hv-cinder-83538 Jun 23 17:16:26.052209 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-4d6ab568-3029-4fd0-b07a-7a732165f8ed req-b878f72e-4b50-4eda-a9e8-3ee30092d928 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034228 Jun 23 17:16:26.052994 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 297/608] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:26.648381 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-8c6b05e1-3e0f-4a1b-925b-0a1d477cdd80 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:26.648916 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-8c6b05e1-3e0f-4a1b-925b-0a1d477cdd80 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:26.655165 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8c6b05e1-3e0f-4a1b-925b-0a1d477cdd80 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:26.655624 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8c6b05e1-3e0f-4a1b-925b-0a1d477cdd80 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:26.656377 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8c6b05e1-3e0f-4a1b-925b-0a1d477cdd80 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:26.656807 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8c6b05e1-3e0f-4a1b-925b-0a1d477cdd80 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:26.788838 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-8c6b05e1-3e0f-4a1b-925b-0a1d477cdd80 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:26.797054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-8c6b05e1-3e0f-4a1b-925b-0a1d477cdd80 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1566 microversion: 2.1 time: 0.152569 Jun 23 17:16:26.797594 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 312/609] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:26 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:26.823349 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-db386fe6-4a08-4d09-a92a-cd25adb24023 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:26.823923 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-db386fe6-4a08-4d09-a92a-cd25adb24023 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:26.830923 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-db386fe6-4a08-4d09-a92a-cd25adb24023 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:26.831368 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-db386fe6-4a08-4d09-a92a-cd25adb24023 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:26.832140 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-db386fe6-4a08-4d09-a92a-cd25adb24023 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:26.832579 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-db386fe6-4a08-4d09-a92a-cd25adb24023 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:26.924475 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-db386fe6-4a08-4d09-a92a-cd25adb24023 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107095 Jun 23 17:16:26.925072 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 298/610] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 23 17:16:26 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:27.032713 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-35a9d60d-9c88-4946-952f-6db605f96efd tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:27.033426 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-35a9d60d-9c88-4946-952f-6db605f96efd tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:27.039989 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-35a9d60d-9c88-4946-952f-6db605f96efd tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:27.040418 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-35a9d60d-9c88-4946-952f-6db605f96efd tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:27.041092 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fd7c5a27-acb6-43ae-a205-0dc721966b78 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:27.041249 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-35a9d60d-9c88-4946-952f-6db605f96efd tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:27.041643 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-35a9d60d-9c88-4946-952f-6db605f96efd tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:27.042034 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fd7c5a27-acb6-43ae-a205-0dc721966b78 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:27.048491 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fd7c5a27-acb6-43ae-a205-0dc721966b78 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:27.049244 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fd7c5a27-acb6-43ae-a205-0dc721966b78 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:27.050264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fd7c5a27-acb6-43ae-a205-0dc721966b78 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:27.050762 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fd7c5a27-acb6-43ae-a205-0dc721966b78 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:27.171204 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-35a9d60d-9c88-4946-952f-6db605f96efd tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:27.180998 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-35a9d60d-9c88-4946-952f-6db605f96efd tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.152182 Jun 23 17:16:27.181583 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 313/611] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:27 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:27.548127 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fd7c5a27-acb6-43ae-a205-0dc721966b78 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:27.557116 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fd7c5a27-acb6-43ae-a205-0dc721966b78 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.520459 Jun 23 17:16:27.557676 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 299/612] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:27 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:16:28.199958 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-82bac0f7-0059-449c-b602-012200b30f1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:28.201213 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-82bac0f7-0059-449c-b602-012200b30f1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:28.209533 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-82bac0f7-0059-449c-b602-012200b30f1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:28.210094 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-82bac0f7-0059-449c-b602-012200b30f1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:28.211092 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-82bac0f7-0059-449c-b602-012200b30f1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:28.211593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-82bac0f7-0059-449c-b602-012200b30f1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:28.245902 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-45d6a43b-e093-4f28-8e0d-f7c63c7b50de req-ea7d978c-85c9-4168-91e0-a43e43ad2627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410f9789-fe14-436c-b928-5e32f1057008", "tag": "3cb62c73-34be-4c1e-ac1b-34d0ab60dbbf"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:28.257777 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-45d6a43b-e093-4f28-8e0d-f7c63c7b50de req-ea7d978c-85c9-4168-91e0-a43e43ad2627 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:28.258653 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-45d6a43b-e093-4f28-8e0d-f7c63c7b50de req-ea7d978c-85c9-4168-91e0-a43e43ad2627 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:28.273456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-45d6a43b-e093-4f28-8e0d-f7c63c7b50de req-ea7d978c-85c9-4168-91e0-a43e43ad2627 service nova] Creating event network-changed:3cb62c73-34be-4c1e-ac1b-34d0ab60dbbf for instance 410f9789-fe14-436c-b928-5e32f1057008 on hv-cinder-83538 Jun 23 17:16:28.279256 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-45d6a43b-e093-4f28-8e0d-f7c63c7b50de req-ea7d978c-85c9-4168-91e0-a43e43ad2627 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037415 Jun 23 17:16:28.280063 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 300/613] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:28.344444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-82bac0f7-0059-449c-b602-012200b30f1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:28.352071 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-82bac0f7-0059-449c-b602-012200b30f1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.157448 Jun 23 17:16:28.352670 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 314/614] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:28 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:28.575565 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6e8aa3c7-f4f9-459b-a0bc-17b6da93cfa2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:28.576381 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6e8aa3c7-f4f9-459b-a0bc-17b6da93cfa2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:28.583192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e8aa3c7-f4f9-459b-a0bc-17b6da93cfa2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:28.583656 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e8aa3c7-f4f9-459b-a0bc-17b6da93cfa2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:28.584398 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e8aa3c7-f4f9-459b-a0bc-17b6da93cfa2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:28.584827 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e8aa3c7-f4f9-459b-a0bc-17b6da93cfa2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:28.723849 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6e8aa3c7-f4f9-459b-a0bc-17b6da93cfa2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:28.738194 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6e8aa3c7-f4f9-459b-a0bc-17b6da93cfa2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.167192 Jun 23 17:16:28.740791 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 301/615] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:28 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:29.369863 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d149e61c-411b-4c91-bde5-3a666c82ac70 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:29.370464 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d149e61c-411b-4c91-bde5-3a666c82ac70 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:29.377184 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d149e61c-411b-4c91-bde5-3a666c82ac70 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:29.377634 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d149e61c-411b-4c91-bde5-3a666c82ac70 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:29.378434 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d149e61c-411b-4c91-bde5-3a666c82ac70 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:29.378867 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d149e61c-411b-4c91-bde5-3a666c82ac70 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:29.719419 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d149e61c-411b-4c91-bde5-3a666c82ac70 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:29.728627 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d149e61c-411b-4c91-bde5-3a666c82ac70 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.363373 Jun 23 17:16:29.729216 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 315/616] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:29 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:29.756608 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4aef5ce8-82c7-4e6b-a746-dce6bb4f2a88 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:29.757223 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4aef5ce8-82c7-4e6b-a746-dce6bb4f2a88 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:29.770731 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4aef5ce8-82c7-4e6b-a746-dce6bb4f2a88 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:29.771185 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4aef5ce8-82c7-4e6b-a746-dce6bb4f2a88 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:29.775460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4aef5ce8-82c7-4e6b-a746-dce6bb4f2a88 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:29.775971 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4aef5ce8-82c7-4e6b-a746-dce6bb4f2a88 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:30.049303 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4aef5ce8-82c7-4e6b-a746-dce6bb4f2a88 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:30.059286 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4aef5ce8-82c7-4e6b-a746-dce6bb4f2a88 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.306078 Jun 23 17:16:30.061088 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 302/617] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:29 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:30.747842 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7d63070c-4212-4efc-aeff-3ae83322f47f tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:30.748484 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7d63070c-4212-4efc-aeff-3ae83322f47f tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:30.755367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d63070c-4212-4efc-aeff-3ae83322f47f tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:30.755839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d63070c-4212-4efc-aeff-3ae83322f47f tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:30.756641 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d63070c-4212-4efc-aeff-3ae83322f47f tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:30.757094 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d63070c-4212-4efc-aeff-3ae83322f47f tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:30.900055 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7d63070c-4212-4efc-aeff-3ae83322f47f tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:30.907560 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7d63070c-4212-4efc-aeff-3ae83322f47f tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.163889 Jun 23 17:16:30.908121 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 316/618] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:30 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:31.076447 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-94af2fff-eb4d-43c5-ab48-99b141893b48 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:31.077050 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-94af2fff-eb4d-43c5-ab48-99b141893b48 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:31.083957 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-94af2fff-eb4d-43c5-ab48-99b141893b48 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:31.084404 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-94af2fff-eb4d-43c5-ab48-99b141893b48 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:31.085170 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-94af2fff-eb4d-43c5-ab48-99b141893b48 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:31.085605 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-94af2fff-eb4d-43c5-ab48-99b141893b48 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:31.243557 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-94af2fff-eb4d-43c5-ab48-99b141893b48 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:31.251458 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-94af2fff-eb4d-43c5-ab48-99b141893b48 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1267 microversion: 2.1 time: 0.178901 Jun 23 17:16:31.252021 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 303/619] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:31 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:31.865419 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-714953aa-ebe7-42bc-8e87-5081fa1760b9 req-dd55006b-3512-433e-98ae-149e119e2494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80236cf3-b3a0-42de-89ee-da5deb3de2a1", "name": "network-vif-plugged", "status": "completed", "tag": "f326af8b-43a2-44c9-902a-68353086ffbf"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:31.875526 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-714953aa-ebe7-42bc-8e87-5081fa1760b9 req-dd55006b-3512-433e-98ae-149e119e2494 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:31.877053 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-714953aa-ebe7-42bc-8e87-5081fa1760b9 req-dd55006b-3512-433e-98ae-149e119e2494 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:31.894685 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-714953aa-ebe7-42bc-8e87-5081fa1760b9 req-dd55006b-3512-433e-98ae-149e119e2494 service nova] Creating event network-vif-plugged:f326af8b-43a2-44c9-902a-68353086ffbf for instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 on hv-cinder-83538 Jun 23 17:16:31.902921 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-714953aa-ebe7-42bc-8e87-5081fa1760b9 req-dd55006b-3512-433e-98ae-149e119e2494 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043883 Jun 23 17:16:31.904118 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 317/620] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:31.924838 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b7068a1a-8bc6-41ee-aec3-d520e57b20c7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:31.925906 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b7068a1a-8bc6-41ee-aec3-d520e57b20c7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:31.932445 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b7068a1a-8bc6-41ee-aec3-d520e57b20c7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:31.933215 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b7068a1a-8bc6-41ee-aec3-d520e57b20c7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:31.934553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b7068a1a-8bc6-41ee-aec3-d520e57b20c7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:31.935236 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b7068a1a-8bc6-41ee-aec3-d520e57b20c7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:32.117946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b7068a1a-8bc6-41ee-aec3-d520e57b20c7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:32.126206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b7068a1a-8bc6-41ee-aec3-d520e57b20c7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.205481 Jun 23 17:16:32.127096 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 304/621] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:31 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:32.148029 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-98316add-479c-4c54-8292-b41f9ef2d674 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Action: 'create', calling method: .version_select at 0x7f342dfc8ee0>, body: {"keypair": {"name": "tempest-keypair-788950638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKC6kAPkYHdV4olSuzSZfyvo0N9eKLFWqfYIpOEE03ekA/xdQjM50ADk42N3JtBU8V/iMy4tz7ijoQ1OgB78wEEGaZclOD1YmNAsmIF4dJqR6BwTU2q2RTN218vA9HyFCg=="}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:32.164070 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-98316add-479c-4c54-8292-b41f9ef2d674 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for project 201cf53eaff642e78cf394182b0b9972. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:16:32.168241 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-98316add-479c-4c54-8292-b41f9ef2d674 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for user fc6a4d6c1f834720a69ee30d5ae63cc9 and project 201cf53eaff642e78cf394182b0b9972. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:16:32.185472 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:32.194098 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-98316add-479c-4c54-8292-b41f9ef2d674 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051179 Jun 23 17:16:32.194929 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 318/622] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 23 17:16:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:32.273180 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a8867c7e-f527-4937-b5df-94b6f6eebb3f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:32.274766 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a8867c7e-f527-4937-b5df-94b6f6eebb3f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:32.281225 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8867c7e-f527-4937-b5df-94b6f6eebb3f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:32.281775 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8867c7e-f527-4937-b5df-94b6f6eebb3f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:32.282774 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8867c7e-f527-4937-b5df-94b6f6eebb3f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:32.283364 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8867c7e-f527-4937-b5df-94b6f6eebb3f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:32.446309 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a8867c7e-f527-4937-b5df-94b6f6eebb3f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:32.454736 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a8867c7e-f527-4937-b5df-94b6f6eebb3f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1453 microversion: 2.1 time: 0.185466 Jun 23 17:16:32.455651 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 305/623] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:32 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:32.471119 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7aee4c6e-5084-45c2-a8c2-6b1e9d9464bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:32.471851 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7aee4c6e-5084-45c2-a8c2-6b1e9d9464bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:32.478480 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7aee4c6e-5084-45c2-a8c2-6b1e9d9464bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:32.479178 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7aee4c6e-5084-45c2-a8c2-6b1e9d9464bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:32.479948 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7aee4c6e-5084-45c2-a8c2-6b1e9d9464bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:32.480538 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7aee4c6e-5084-45c2-a8c2-6b1e9d9464bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:32.654149 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7aee4c6e-5084-45c2-a8c2-6b1e9d9464bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:32.662921 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7aee4c6e-5084-45c2-a8c2-6b1e9d9464bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1453 microversion: 2.1 time: 0.195719 Jun 23 17:16:32.663639 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 319/624] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:32 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1453 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:33.146101 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-392cfb11-1cff-4d13-9dfb-89c67717446d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:33.147314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-392cfb11-1cff-4d13-9dfb-89c67717446d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:33.157033 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-392cfb11-1cff-4d13-9dfb-89c67717446d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:33.159106 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-392cfb11-1cff-4d13-9dfb-89c67717446d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:33.160146 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-392cfb11-1cff-4d13-9dfb-89c67717446d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:33.160736 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-392cfb11-1cff-4d13-9dfb-89c67717446d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:33.439183 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-392cfb11-1cff-4d13-9dfb-89c67717446d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:33.447903 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-392cfb11-1cff-4d13-9dfb-89c67717446d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.307721 Jun 23 17:16:33.448579 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 306/625] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:33 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:33.909482 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-176493409", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3cd0a13-7d3d-4379-9bdb-f7a035d3d8b1"}], "security_groups": [{"name": "tempest-securitygroup--1589924175"}], "key_name": "tempest-keypair-788950638", "user_data": "}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:34.026886 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.network.neutron [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] validate_networks() for [('a3cd0a13-7d3d-4379-9bdb-f7a035d3d8b1', None, None, None, None, None)] {{(pid=117897) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:16:34.414416 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Flavor limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:16:34.414996 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Image limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:16:34.415560 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Flavor pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:16:34.415974 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Image pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:16:34.416385 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:16:34.425785 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:34.426276 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:34.427096 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:34.427532 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:34.445495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for project 201cf53eaff642e78cf394182b0b9972. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:16:34.449979 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for user fc6a4d6c1f834720a69ee30d5ae63cc9 and project 201cf53eaff642e78cf394182b0b9972. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:16:34.463034 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Going to run 1 instances... {{(pid=117897) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:16:34.464495 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-77d01cb4-3bc5-40b3-b68a-04a1f8f1359b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:34.465080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-77d01cb4-3bc5-40b3-b68a-04a1f8f1359b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:34.465382 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:16:34.471963 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-77d01cb4-3bc5-40b3-b68a-04a1f8f1359b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:34.472125 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-77d01cb4-3bc5-40b3-b68a-04a1f8f1359b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:34.472853 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-77d01cb4-3bc5-40b3-b68a-04a1f8f1359b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:34.473283 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-77d01cb4-3bc5-40b3-b68a-04a1f8f1359b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:34.518985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-145cb92d-47f8-40d4-89e4-d271a3b2dbdf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.613726 Jun 23 17:16:34.519855 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 320/626] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:16:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:16:34.530148 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f776e97a-9e41-456a-a5ed-2955537cd874 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:34.530757 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f776e97a-9e41-456a-a5ed-2955537cd874 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:34.591100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f776e97a-9e41-456a-a5ed-2955537cd874 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:34.599366 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f776e97a-9e41-456a-a5ed-2955537cd874 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1240 microversion: 2.1 time: 0.072232 Jun 23 17:16:34.600038 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 321/627] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:34 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:16:34.960683 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-77d01cb4-3bc5-40b3-b68a-04a1f8f1359b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:34.970236 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-77d01cb4-3bc5-40b3-b68a-04a1f8f1359b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1358 microversion: 2.1 time: 0.509513 Jun 23 17:16:34.971014 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 307/628] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:34 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1358 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:16:35.196303 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-be912f0f-65e3-43ee-a68b-31feb0275a42 req-480a61cf-461e-49a3-a689-4a6b35b57994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8f045dd-0ec4-4225-8bae-0035daa2c0ee", "tag": "5e0d8b7e-7e66-48e6-b53e-f85a41aeb721"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:35.205365 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-be912f0f-65e3-43ee-a68b-31feb0275a42 req-480a61cf-461e-49a3-a689-4a6b35b57994 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:35.205782 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-be912f0f-65e3-43ee-a68b-31feb0275a42 req-480a61cf-461e-49a3-a689-4a6b35b57994 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:35.216582 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-be912f0f-65e3-43ee-a68b-31feb0275a42 req-480a61cf-461e-49a3-a689-4a6b35b57994 service nova] Creating event network-changed:5e0d8b7e-7e66-48e6-b53e-f85a41aeb721 for instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee on hv-cinder-83538 Jun 23 17:16:35.221986 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-be912f0f-65e3-43ee-a68b-31feb0275a42 req-480a61cf-461e-49a3-a689-4a6b35b57994 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029413 Jun 23 17:16:35.223479 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 322/629] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:35.616657 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-872e0b00-499d-4dd9-ad4b-d1a4c35d9c6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:35.617547 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-872e0b00-499d-4dd9-ad4b-d1a4c35d9c6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:35.625586 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-872e0b00-499d-4dd9-ad4b-d1a4c35d9c6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:35.626093 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-872e0b00-499d-4dd9-ad4b-d1a4c35d9c6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:35.626877 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-872e0b00-499d-4dd9-ad4b-d1a4c35d9c6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:35.627278 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-872e0b00-499d-4dd9-ad4b-d1a4c35d9c6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:35.709232 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-872e0b00-499d-4dd9-ad4b-d1a4c35d9c6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:35.717962 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-872e0b00-499d-4dd9-ad4b-d1a4c35d9c6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1236 microversion: 2.1 time: 0.104998 Jun 23 17:16:35.718553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 308/630] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:35 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1236 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:35.988467 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-bd332132-fd0f-48a7-989c-f503257ca2d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:35.989162 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-bd332132-fd0f-48a7-989c-f503257ca2d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:35.995755 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bd332132-fd0f-48a7-989c-f503257ca2d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:35.996200 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bd332132-fd0f-48a7-989c-f503257ca2d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:35.996956 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bd332132-fd0f-48a7-989c-f503257ca2d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:35.997408 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bd332132-fd0f-48a7-989c-f503257ca2d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:36.160102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-bd332132-fd0f-48a7-989c-f503257ca2d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:36.171219 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-bd332132-fd0f-48a7-989c-f503257ca2d2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1548 microversion: 2.1 time: 0.187028 Jun 23 17:16:36.178220 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 323/631] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:35 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1548 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:36.190270 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4c28a50e-7b76-4ba7-b71b-1c79940c0a23 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:36.190932 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4c28a50e-7b76-4ba7-b71b-1c79940c0a23 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:36.197888 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4c28a50e-7b76-4ba7-b71b-1c79940c0a23 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:36.198345 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4c28a50e-7b76-4ba7-b71b-1c79940c0a23 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:36.199155 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4c28a50e-7b76-4ba7-b71b-1c79940c0a23 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:36.199593 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4c28a50e-7b76-4ba7-b71b-1c79940c0a23 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:36.380581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4c28a50e-7b76-4ba7-b71b-1c79940c0a23 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:36.393095 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4c28a50e-7b76-4ba7-b71b-1c79940c0a23 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1548 microversion: 2.1 time: 0.207541 Jun 23 17:16:36.413496 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d7fc3645-9c54-497d-82ef-fdb0763f7571 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:36.417915 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 309/632] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:36 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1548 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:36.418548 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d7fc3645-9c54-497d-82ef-fdb0763f7571 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:36.419347 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d7fc3645-9c54-497d-82ef-fdb0763f7571 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Searching by: {'deleted': False, 'project_id': '26dde39423224c57b71005a60dacbed3'} {{(pid=117897) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 23 17:16:36.426672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d7fc3645-9c54-497d-82ef-fdb0763f7571 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:36.427480 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d7fc3645-9c54-497d-82ef-fdb0763f7571 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:36.429087 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d7fc3645-9c54-497d-82ef-fdb0763f7571 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:36.430008 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d7fc3645-9c54-497d-82ef-fdb0763f7571 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:36.529177 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.multi_cell_list [None req-d7fc3645-9c54-497d-82ef-fdb0763f7571 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117897) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 23 17:16:36.625072 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d7fc3645-9c54-497d-82ef-fdb0763f7571 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.218101 Jun 23 17:16:36.625656 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 324/633] 10.222.0.18 () {58 vars in 1124 bytes} [Thu Jun 23 17:16:36 2022] GET /compute/v2.1/servers => generated 342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:36.636427 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-377afe8f-f39e-464d-a086-a6361a3ca4c9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:36.637035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-377afe8f-f39e-464d-a086-a6361a3ca4c9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:36.643922 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-377afe8f-f39e-464d-a086-a6361a3ca4c9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:36.644368 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-377afe8f-f39e-464d-a086-a6361a3ca4c9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:36.645104 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-377afe8f-f39e-464d-a086-a6361a3ca4c9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:36.645535 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-377afe8f-f39e-464d-a086-a6361a3ca4c9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:36.735897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7d334433-c6f9-4d8f-9059-6e2fb61e19a6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:36.736508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7d334433-c6f9-4d8f-9059-6e2fb61e19a6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:36.743104 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d334433-c6f9-4d8f-9059-6e2fb61e19a6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:36.743550 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d334433-c6f9-4d8f-9059-6e2fb61e19a6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:36.744319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d334433-c6f9-4d8f-9059-6e2fb61e19a6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:36.744750 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d334433-c6f9-4d8f-9059-6e2fb61e19a6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:36.812470 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7d334433-c6f9-4d8f-9059-6e2fb61e19a6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:36.820013 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7d334433-c6f9-4d8f-9059-6e2fb61e19a6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1298 microversion: 2.1 time: 0.088165 Jun 23 17:16:36.820575 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 325/634] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:36 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:36.861683 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-377afe8f-f39e-464d-a086-a6361a3ca4c9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:36.869816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-377afe8f-f39e-464d-a086-a6361a3ca4c9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1548 microversion: 2.1 time: 0.237551 Jun 23 17:16:36.870470 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 310/635] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:36 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1548 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:37.841667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f9c41b12-f612-4c97-b15f-78e087aa8eff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:37.845269 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f9c41b12-f612-4c97-b15f-78e087aa8eff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:37.852165 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f9c41b12-f612-4c97-b15f-78e087aa8eff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:37.852911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f9c41b12-f612-4c97-b15f-78e087aa8eff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:37.853663 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f9c41b12-f612-4c97-b15f-78e087aa8eff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:37.854293 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f9c41b12-f612-4c97-b15f-78e087aa8eff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:37.859015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:37.994864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f9c41b12-f612-4c97-b15f-78e087aa8eff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:38.009712 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f9c41b12-f612-4c97-b15f-78e087aa8eff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1366 microversion: 2.1 time: 0.171269 Jun 23 17:16:38.010553 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 326/636] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:37 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:38.063607 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-da2989cd-fbeb-40e1-9bb3-b3c8ad0217e0 req-f2c5f9f9-abbc-4094-9bc5-ed53c4613060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5991769-2ad6-41ff-a83c-2164828f7811", "tag": "9d5c62e1-bf25-4a83-93de-3d9cfb07d904"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:38.069552 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=60 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:38.074134 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-da2989cd-fbeb-40e1-9bb3-b3c8ad0217e0 req-f2c5f9f9-abbc-4094-9bc5-ed53c4613060 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:38.074571 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-da2989cd-fbeb-40e1-9bb3-b3c8ad0217e0 req-f2c5f9f9-abbc-4094-9bc5-ed53c4613060 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:38.088256 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-da2989cd-fbeb-40e1-9bb3-b3c8ad0217e0 req-f2c5f9f9-abbc-4094-9bc5-ed53c4613060 service nova] Creating event network-changed:9d5c62e1-bf25-4a83-93de-3d9cfb07d904 for instance a5991769-2ad6-41ff-a83c-2164828f7811 on hv-cinder-83538 Jun 23 17:16:38.093728 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-da2989cd-fbeb-40e1-9bb3-b3c8ad0217e0 req-f2c5f9f9-abbc-4094-9bc5-ed53c4613060 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033657 Jun 23 17:16:38.094558 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 311/637] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:38.409097 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-24c3cebb-0236-4e0b-9158-3ab76d0c90b7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9fc3aa1-0b2b-4997-8af1-4cf72408205c"}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:38.410207 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-24c3cebb-0236-4e0b-9158-3ab76d0c90b7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:38.416282 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-24c3cebb-0236-4e0b-9158-3ab76d0c90b7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:38.416730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-24c3cebb-0236-4e0b-9158-3ab76d0c90b7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:38.417482 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-24c3cebb-0236-4e0b-9158-3ab76d0c90b7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:38.417947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-24c3cebb-0236-4e0b-9158-3ab76d0c90b7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:38.751352 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-24c3cebb-0236-4e0b-9158-3ab76d0c90b7 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "POST /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345912 Jun 23 17:16:38.752001 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 327/638] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 23 17:16:38 2022] POST /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:39.029441 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3cf0152e-77df-4099-b7e4-ba4c7e9df2fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:39.030352 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3cf0152e-77df-4099-b7e4-ba4c7e9df2fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:39.037014 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3cf0152e-77df-4099-b7e4-ba4c7e9df2fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:39.037476 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3cf0152e-77df-4099-b7e4-ba4c7e9df2fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:39.038262 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3cf0152e-77df-4099-b7e4-ba4c7e9df2fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:39.038693 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3cf0152e-77df-4099-b7e4-ba4c7e9df2fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:39.178781 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3cf0152e-77df-4099-b7e4-ba4c7e9df2fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:39.187300 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3cf0152e-77df-4099-b7e4-ba4c7e9df2fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1366 microversion: 2.1 time: 0.162267 Jun 23 17:16:39.188039 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 312/639] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:39 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:40.210307 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b27d4ac3-5a93-4e9a-b792-92afc1e61770 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:40.211395 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b27d4ac3-5a93-4e9a-b792-92afc1e61770 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:40.222216 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b27d4ac3-5a93-4e9a-b792-92afc1e61770 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:40.222949 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b27d4ac3-5a93-4e9a-b792-92afc1e61770 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:40.224185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b27d4ac3-5a93-4e9a-b792-92afc1e61770 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:40.224909 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b27d4ac3-5a93-4e9a-b792-92afc1e61770 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:40.374473 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b27d4ac3-5a93-4e9a-b792-92afc1e61770 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:40.384959 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b27d4ac3-5a93-4e9a-b792-92afc1e61770 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1366 microversion: 2.1 time: 0.182779 Jun 23 17:16:40.385524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 328/640] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:40 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:41.404266 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9188e865-55e9-48a4-a72f-fbceb4c75a57 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:41.404882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9188e865-55e9-48a4-a72f-fbceb4c75a57 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:41.412203 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9188e865-55e9-48a4-a72f-fbceb4c75a57 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:41.412652 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9188e865-55e9-48a4-a72f-fbceb4c75a57 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:41.413423 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9188e865-55e9-48a4-a72f-fbceb4c75a57 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:41.413867 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9188e865-55e9-48a4-a72f-fbceb4c75a57 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:41.555253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9188e865-55e9-48a4-a72f-fbceb4c75a57 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:41.563590 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9188e865-55e9-48a4-a72f-fbceb4c75a57 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1366 microversion: 2.1 time: 0.164032 Jun 23 17:16:41.564161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 313/641] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:41 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:42.582717 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-70bd2a37-a4cd-47f8-8a1d-d920235ade81 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:42.583417 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-70bd2a37-a4cd-47f8-8a1d-d920235ade81 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:42.590472 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-70bd2a37-a4cd-47f8-8a1d-d920235ade81 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:42.590917 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-70bd2a37-a4cd-47f8-8a1d-d920235ade81 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:42.591654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-70bd2a37-a4cd-47f8-8a1d-d920235ade81 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:42.592084 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-70bd2a37-a4cd-47f8-8a1d-d920235ade81 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:42.719929 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-70bd2a37-a4cd-47f8-8a1d-d920235ade81 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:42.728033 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-70bd2a37-a4cd-47f8-8a1d-d920235ade81 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1366 microversion: 2.1 time: 0.150830 Jun 23 17:16:42.728565 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 329/642] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:42 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:43.746234 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-86495e93-9fef-4387-8f50-a600a51f4a9d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:43.746842 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-86495e93-9fef-4387-8f50-a600a51f4a9d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:43.754158 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-86495e93-9fef-4387-8f50-a600a51f4a9d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:43.754606 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-86495e93-9fef-4387-8f50-a600a51f4a9d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:43.755370 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-86495e93-9fef-4387-8f50-a600a51f4a9d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:43.755805 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-86495e93-9fef-4387-8f50-a600a51f4a9d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:43.901672 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-86495e93-9fef-4387-8f50-a600a51f4a9d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:43.909532 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-86495e93-9fef-4387-8f50-a600a51f4a9d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1366 microversion: 2.1 time: 0.167971 Jun 23 17:16:43.910249 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 314/643] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:43 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:44.195874 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-23535654-9107-43d8-834b-88961334d15c req-cadc3e63-33dc-418b-b12f-803b0fd5e401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5991769-2ad6-41ff-a83c-2164828f7811", "name": "network-vif-plugged", "status": "completed", "tag": "9d5c62e1-bf25-4a83-93de-3d9cfb07d904"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:44.205275 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-23535654-9107-43d8-834b-88961334d15c req-cadc3e63-33dc-418b-b12f-803b0fd5e401 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:44.205667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-23535654-9107-43d8-834b-88961334d15c req-cadc3e63-33dc-418b-b12f-803b0fd5e401 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:44.216992 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-23535654-9107-43d8-834b-88961334d15c req-cadc3e63-33dc-418b-b12f-803b0fd5e401 service nova] Creating event network-vif-plugged:9d5c62e1-bf25-4a83-93de-3d9cfb07d904 for instance a5991769-2ad6-41ff-a83c-2164828f7811 on hv-cinder-83538 Jun 23 17:16:44.221978 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-23535654-9107-43d8-834b-88961334d15c req-cadc3e63-33dc-418b-b12f-803b0fd5e401 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029843 Jun 23 17:16:44.222570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 330/644] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:44.929354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c76b4c8f-354d-4066-a26a-575380c86ce1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:44.930174 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c76b4c8f-354d-4066-a26a-575380c86ce1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:44.938050 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c76b4c8f-354d-4066-a26a-575380c86ce1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:44.938497 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c76b4c8f-354d-4066-a26a-575380c86ce1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:44.939255 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c76b4c8f-354d-4066-a26a-575380c86ce1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:44.939691 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c76b4c8f-354d-4066-a26a-575380c86ce1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:45.074502 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c76b4c8f-354d-4066-a26a-575380c86ce1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:45.082310 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c76b4c8f-354d-4066-a26a-575380c86ce1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1366 microversion: 2.1 time: 0.158268 Jun 23 17:16:45.082875 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 315/645] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:44 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:46.098624 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=12 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:46.105417 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c2f5ba99-e674-4ab6-ae23-8ffb9f860573 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:46.106154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c2f5ba99-e674-4ab6-ae23-8ffb9f860573 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:46.113003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c2f5ba99-e674-4ab6-ae23-8ffb9f860573 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:46.113454 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c2f5ba99-e674-4ab6-ae23-8ffb9f860573 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:46.114252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c2f5ba99-e674-4ab6-ae23-8ffb9f860573 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:46.114688 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c2f5ba99-e674-4ab6-ae23-8ffb9f860573 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:46.247140 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c2f5ba99-e674-4ab6-ae23-8ffb9f860573 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:46.254736 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c2f5ba99-e674-4ab6-ae23-8ffb9f860573 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1366 microversion: 2.1 time: 0.158003 Jun 23 17:16:46.255314 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 331/646] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:46 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:47.272741 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c785dce6-8af2-425b-9909-fe987a37e2ac tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:47.273754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c785dce6-8af2-425b-9909-fe987a37e2ac tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:47.280975 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c785dce6-8af2-425b-9909-fe987a37e2ac tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:47.281567 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c785dce6-8af2-425b-9909-fe987a37e2ac tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:47.282364 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c785dce6-8af2-425b-9909-fe987a37e2ac tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:47.282806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c785dce6-8af2-425b-9909-fe987a37e2ac tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:47.285529 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:47.415361 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c785dce6-8af2-425b-9909-fe987a37e2ac tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:47.424222 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c785dce6-8af2-425b-9909-fe987a37e2ac tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1556 microversion: 2.1 time: 0.155980 Jun 23 17:16:47.424798 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 316/647] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:47 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:47.441553 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9356d405-dd2f-4bba-baf7-a514246b73cf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:47.442123 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9356d405-dd2f-4bba-baf7-a514246b73cf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:47.444046 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=4 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:47.451441 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9356d405-dd2f-4bba-baf7-a514246b73cf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:47.451878 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9356d405-dd2f-4bba-baf7-a514246b73cf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:47.452638 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9356d405-dd2f-4bba-baf7-a514246b73cf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:47.453073 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9356d405-dd2f-4bba-baf7-a514246b73cf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:47.535983 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9356d405-dd2f-4bba-baf7-a514246b73cf tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098018 Jun 23 17:16:47.536682 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 332/648] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 23 17:16:47 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:48.730701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-3ca0c73a-0106-4c5e-9f77-f2c21ca79944 req-9790c305-4e5f-4c69-beb5-959d6d319687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5991769-2ad6-41ff-a83c-2164828f7811", "tag": "9d5c62e1-bf25-4a83-93de-3d9cfb07d904"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:48.739505 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-3ca0c73a-0106-4c5e-9f77-f2c21ca79944 req-9790c305-4e5f-4c69-beb5-959d6d319687 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:48.739951 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-3ca0c73a-0106-4c5e-9f77-f2c21ca79944 req-9790c305-4e5f-4c69-beb5-959d6d319687 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:48.751233 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-3ca0c73a-0106-4c5e-9f77-f2c21ca79944 req-9790c305-4e5f-4c69-beb5-959d6d319687 service nova] Creating event network-changed:9d5c62e1-bf25-4a83-93de-3d9cfb07d904 for instance a5991769-2ad6-41ff-a83c-2164828f7811 on hv-cinder-83538 Jun 23 17:16:48.756260 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-3ca0c73a-0106-4c5e-9f77-f2c21ca79944 req-9790c305-4e5f-4c69-beb5-959d6d319687 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029579 Jun 23 17:16:48.757053 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 317/649] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:49.525911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c3018989-a596-4d11-8b77-50b6eb254659 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:49.526719 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c3018989-a596-4d11-8b77-50b6eb254659 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:49.533103 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c3018989-a596-4d11-8b77-50b6eb254659 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:49.533608 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c3018989-a596-4d11-8b77-50b6eb254659 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:49.534466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c3018989-a596-4d11-8b77-50b6eb254659 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:49.534960 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c3018989-a596-4d11-8b77-50b6eb254659 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:49.674272 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c3018989-a596-4d11-8b77-50b6eb254659 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:49.685719 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c3018989-a596-4d11-8b77-50b6eb254659 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1594 microversion: 2.1 time: 0.164424 Jun 23 17:16:49.686550 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 333/650] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:49 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1594 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:16:51.621248 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-8e018f6a-3769-4639-b3e2-f2625851b5fa req-ec2676e6-4d1f-4a97-aec5-cd670365dcdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80236cf3-b3a0-42de-89ee-da5deb3de2a1", "tag": "f326af8b-43a2-44c9-902a-68353086ffbf"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:51.629870 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-8e018f6a-3769-4639-b3e2-f2625851b5fa req-ec2676e6-4d1f-4a97-aec5-cd670365dcdb service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:51.630605 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-8e018f6a-3769-4639-b3e2-f2625851b5fa req-ec2676e6-4d1f-4a97-aec5-cd670365dcdb service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:51.643995 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-8e018f6a-3769-4639-b3e2-f2625851b5fa req-ec2676e6-4d1f-4a97-aec5-cd670365dcdb service nova] Creating event network-changed:f326af8b-43a2-44c9-902a-68353086ffbf for instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 on hv-cinder-83538 Jun 23 17:16:51.651050 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-8e018f6a-3769-4639-b3e2-f2625851b5fa req-ec2676e6-4d1f-4a97-aec5-cd670365dcdb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033824 Jun 23 17:16:51.652028 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 318/651] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:52.840465 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-663a5e3c-6ee5-4587-8939-29cfa335ee1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-585408897"}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:52.841119 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-663a5e3c-6ee5-4587-8939-29cfa335ee1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:52.848071 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-663a5e3c-6ee5-4587-8939-29cfa335ee1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:52.848453 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-663a5e3c-6ee5-4587-8939-29cfa335ee1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:52.849205 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-663a5e3c-6ee5-4587-8939-29cfa335ee1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:52.849635 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-663a5e3c-6ee5-4587-8939-29cfa335ee1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:52.979855 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.network.security_group_api [None req-663a5e3c-6ee5-4587-8939-29cfa335ee1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Adding security group cb78783d-ec84-4997-acd0-f10a4bde3494 to port f326af8b-43a2-44c9-902a-68353086ffbf Jun 23 17:16:53.398373 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-663a5e3c-6ee5-4587-8939-29cfa335ee1b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "POST /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/action" status: 202 len: 0 microversion: 2.1 time: 0.561466 Jun 23 17:16:53.404395 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 334/652] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 23 17:16:52 2022] POST /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:16:53.409556 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4d62ce9c-a992-410c-bfce-4ddfb610b7e2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:16:53.410476 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4d62ce9c-a992-410c-bfce-4ddfb610b7e2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:16:53.416667 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-0e800d73-7e65-4edd-bee0-abb0d64b55b3 req-4cdd03a4-517a-497b-9633-1b966cd5af79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80236cf3-b3a0-42de-89ee-da5deb3de2a1", "tag": "f326af8b-43a2-44c9-902a-68353086ffbf"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:16:53.418355 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4d62ce9c-a992-410c-bfce-4ddfb610b7e2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:53.419069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4d62ce9c-a992-410c-bfce-4ddfb610b7e2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:53.420258 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4d62ce9c-a992-410c-bfce-4ddfb610b7e2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:53.420912 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4d62ce9c-a992-410c-bfce-4ddfb610b7e2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:53.434131 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-0e800d73-7e65-4edd-bee0-abb0d64b55b3 req-4cdd03a4-517a-497b-9633-1b966cd5af79 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:16:53.434584 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-0e800d73-7e65-4edd-bee0-abb0d64b55b3 req-4cdd03a4-517a-497b-9633-1b966cd5af79 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:16:53.449218 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-0e800d73-7e65-4edd-bee0-abb0d64b55b3 req-4cdd03a4-517a-497b-9633-1b966cd5af79 service nova] Creating event network-changed:f326af8b-43a2-44c9-902a-68353086ffbf for instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 on hv-cinder-83538 Jun 23 17:16:53.454774 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-0e800d73-7e65-4edd-bee0-abb0d64b55b3 req-4cdd03a4-517a-497b-9633-1b966cd5af79 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049932 Jun 23 17:16:53.455756 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 319/653] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:16:53.594362 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4d62ce9c-a992-410c-bfce-4ddfb610b7e2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:16:53.605134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4d62ce9c-a992-410c-bfce-4ddfb610b7e2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1759 microversion: 2.1 time: 0.199053 Jun 23 17:16:53.605874 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 335/654] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:16:53 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1759 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:17:58.463902 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=17 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:17:58.465112 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=11 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:17:58.656309 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f227d2e9-5053-41ee-894b-19940dbe9e6b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cec0368b-5e40-4664-b93e-aa42cbb91c35"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:17:58.657508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f227d2e9-5053-41ee-894b-19940dbe9e6b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:17:58.663983 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f227d2e9-5053-41ee-894b-19940dbe9e6b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:17:58.664425 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f227d2e9-5053-41ee-894b-19940dbe9e6b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:17:58.665166 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f227d2e9-5053-41ee-894b-19940dbe9e6b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:17:58.665593 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f227d2e9-5053-41ee-894b-19940dbe9e6b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:17:59.080853 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f227d2e9-5053-41ee-894b-19940dbe9e6b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "POST /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.621351 Jun 23 17:17:59.081477 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 320/655] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 23 17:17:58 2022] POST /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-volume_attachments => generated 194 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:18:07.701821 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=49 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:07.702995 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:07.707358 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-95cf683e-99ae-4cef-9062-b96f5d692d25 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:07.708358 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-95cf683e-99ae-4cef-9062-b96f5d692d25 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:07.716426 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-95cf683e-99ae-4cef-9062-b96f5d692d25 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:07.716891 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-95cf683e-99ae-4cef-9062-b96f5d692d25 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:07.717703 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-95cf683e-99ae-4cef-9062-b96f5d692d25 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:07.718308 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-95cf683e-99ae-4cef-9062-b96f5d692d25 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:07.742220 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-95cf683e-99ae-4cef-9062-b96f5d692d25 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lazy-loading 'flavor' on Instance uuid 410f9789-fe14-436c-b928-5e32f1057008 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:18:07.928459 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-95cf683e-99ae-4cef-9062-b96f5d692d25 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "POST /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/action" status: 200 len: 32 microversion: 2.1 time: 0.228434 Jun 23 17:18:07.929337 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 336/656] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 23 17:18:07 2022] POST /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 17:18:07.929901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-78a46847-ab29-4b7c-899e-418cf005a851 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:07.930974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-78a46847-ab29-4b7c-899e-418cf005a851 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:07.938202 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78a46847-ab29-4b7c-899e-418cf005a851 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:07.939059 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78a46847-ab29-4b7c-899e-418cf005a851 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:07.940186 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78a46847-ab29-4b7c-899e-418cf005a851 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:07.940818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78a46847-ab29-4b7c-899e-418cf005a851 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:07.942628 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-64a9e0e9-20e2-43a3-a3df-73a210c613ec tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:07.943414 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-64a9e0e9-20e2-43a3-a3df-73a210c613ec tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:07.950631 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-64a9e0e9-20e2-43a3-a3df-73a210c613ec tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:07.951085 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-64a9e0e9-20e2-43a3-a3df-73a210c613ec tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:07.951877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-64a9e0e9-20e2-43a3-a3df-73a210c613ec tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:07.952411 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-64a9e0e9-20e2-43a3-a3df-73a210c613ec tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:08.021690 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-78a46847-ab29-4b7c-899e-418cf005a851 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "POST /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/action" status: 202 len: 0 microversion: 2.1 time: 0.098127 Jun 23 17:18:08.022558 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 321/657] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 23 17:18:07 2022] POST /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 17:18:08.031282 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3c205651-e788-4b6f-9f55-9a1bf8a5117a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:08.031974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3c205651-e788-4b6f-9f55-9a1bf8a5117a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:08.038710 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3c205651-e788-4b6f-9f55-9a1bf8a5117a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:08.039157 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3c205651-e788-4b6f-9f55-9a1bf8a5117a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:08.039988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3c205651-e788-4b6f-9f55-9a1bf8a5117a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:08.040554 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3c205651-e788-4b6f-9f55-9a1bf8a5117a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:08.151040 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-64a9e0e9-20e2-43a3-a3df-73a210c613ec tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:08.159514 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-64a9e0e9-20e2-43a3-a3df-73a210c613ec tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.224668 Jun 23 17:18:08.160564 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 337/658] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:07 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:08.395607 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3c205651-e788-4b6f-9f55-9a1bf8a5117a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:08.404988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3c205651-e788-4b6f-9f55-9a1bf8a5117a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1751 microversion: 2.1 time: 0.378192 Jun 23 17:18:08.405910 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 322/659] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:08 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1751 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:18:09.176687 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-41e64cc1-56e7-4b9e-a1a6-c0113fc529b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:09.177281 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-41e64cc1-56e7-4b9e-a1a6-c0113fc529b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:09.183961 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-41e64cc1-56e7-4b9e-a1a6-c0113fc529b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:09.184398 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-41e64cc1-56e7-4b9e-a1a6-c0113fc529b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:09.185140 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-41e64cc1-56e7-4b9e-a1a6-c0113fc529b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:09.185562 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-41e64cc1-56e7-4b9e-a1a6-c0113fc529b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:09.315450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-41e64cc1-56e7-4b9e-a1a6-c0113fc529b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:09.326982 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-41e64cc1-56e7-4b9e-a1a6-c0113fc529b6 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.154000 Jun 23 17:18:09.327807 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 338/660] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:09 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:09.424635 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a5d9b4cf-71c2-4b5b-b857-970338ce917d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:09.425213 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a5d9b4cf-71c2-4b5b-b857-970338ce917d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:09.432792 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5d9b4cf-71c2-4b5b-b857-970338ce917d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:09.433164 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5d9b4cf-71c2-4b5b-b857-970338ce917d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:09.433954 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5d9b4cf-71c2-4b5b-b857-970338ce917d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:09.434377 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5d9b4cf-71c2-4b5b-b857-970338ce917d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:09.590211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a5d9b4cf-71c2-4b5b-b857-970338ce917d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:09.599397 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a5d9b4cf-71c2-4b5b-b857-970338ce917d tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1756 microversion: 2.1 time: 0.179694 Jun 23 17:18:09.599990 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 323/661] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:09 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:10.345581 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9ae6840d-cfab-44aa-a0a4-6a432fcdaf52 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:10.346269 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9ae6840d-cfab-44aa-a0a4-6a432fcdaf52 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:10.353371 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9ae6840d-cfab-44aa-a0a4-6a432fcdaf52 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:10.353839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9ae6840d-cfab-44aa-a0a4-6a432fcdaf52 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:10.354614 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9ae6840d-cfab-44aa-a0a4-6a432fcdaf52 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:10.355054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9ae6840d-cfab-44aa-a0a4-6a432fcdaf52 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:10.487398 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9ae6840d-cfab-44aa-a0a4-6a432fcdaf52 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:10.495537 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9ae6840d-cfab-44aa-a0a4-6a432fcdaf52 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.154298 Jun 23 17:18:10.496089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 339/662] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:10 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:10.620558 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-54847997-722e-4096-8295-25918c8100c1 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:10.621224 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-54847997-722e-4096-8295-25918c8100c1 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:10.628929 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-54847997-722e-4096-8295-25918c8100c1 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:10.629387 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-54847997-722e-4096-8295-25918c8100c1 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:10.630221 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-54847997-722e-4096-8295-25918c8100c1 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:10.630633 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-54847997-722e-4096-8295-25918c8100c1 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:10.784619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-54847997-722e-4096-8295-25918c8100c1 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:10.797048 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-54847997-722e-4096-8295-25918c8100c1 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1756 microversion: 2.1 time: 0.181644 Jun 23 17:18:10.797625 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 324/663] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:10 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:11.516690 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-2bbeea7f-74b2-4e0f-98b2-690d9f8595ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:11.517359 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-2bbeea7f-74b2-4e0f-98b2-690d9f8595ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:11.525390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2bbeea7f-74b2-4e0f-98b2-690d9f8595ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:11.525952 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2bbeea7f-74b2-4e0f-98b2-690d9f8595ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:11.526840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2bbeea7f-74b2-4e0f-98b2-690d9f8595ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:11.527347 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2bbeea7f-74b2-4e0f-98b2-690d9f8595ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:11.667895 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2bbeea7f-74b2-4e0f-98b2-690d9f8595ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:11.676512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-2bbeea7f-74b2-4e0f-98b2-690d9f8595ac tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.165786 Jun 23 17:18:11.677086 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 340/664] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:11 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:11.814970 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-43a2b1bd-2d23-4a21-b0f2-53403fbc6c3c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:11.815546 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-43a2b1bd-2d23-4a21-b0f2-53403fbc6c3c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:11.822531 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43a2b1bd-2d23-4a21-b0f2-53403fbc6c3c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:11.822971 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43a2b1bd-2d23-4a21-b0f2-53403fbc6c3c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:11.823715 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43a2b1bd-2d23-4a21-b0f2-53403fbc6c3c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:11.824143 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43a2b1bd-2d23-4a21-b0f2-53403fbc6c3c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:11.971005 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-43a2b1bd-2d23-4a21-b0f2-53403fbc6c3c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:11.983397 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-43a2b1bd-2d23-4a21-b0f2-53403fbc6c3c tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1756 microversion: 2.1 time: 0.172130 Jun 23 17:18:11.984252 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 325/665] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:11 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:12.695366 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1df37fc7-eba3-499a-a93a-775580173474 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:12.696159 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1df37fc7-eba3-499a-a93a-775580173474 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:12.704940 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1df37fc7-eba3-499a-a93a-775580173474 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:12.705494 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1df37fc7-eba3-499a-a93a-775580173474 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:12.706494 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1df37fc7-eba3-499a-a93a-775580173474 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:12.707033 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1df37fc7-eba3-499a-a93a-775580173474 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:12.848399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1df37fc7-eba3-499a-a93a-775580173474 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:12.856483 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1df37fc7-eba3-499a-a93a-775580173474 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.166013 Jun 23 17:18:12.857051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 341/666] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:12 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:13.011016 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b97a2a35-b8b7-4bbb-a243-772726692111 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:13.011897 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b97a2a35-b8b7-4bbb-a243-772726692111 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:13.020965 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b97a2a35-b8b7-4bbb-a243-772726692111 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:13.021418 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b97a2a35-b8b7-4bbb-a243-772726692111 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:13.022220 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b97a2a35-b8b7-4bbb-a243-772726692111 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:13.022659 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b97a2a35-b8b7-4bbb-a243-772726692111 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:13.173341 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b97a2a35-b8b7-4bbb-a243-772726692111 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:13.182349 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b97a2a35-b8b7-4bbb-a243-772726692111 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1756 microversion: 2.1 time: 0.178096 Jun 23 17:18:13.182912 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 326/667] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:13 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:13.878498 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c126cbd4-f494-46e9-aacf-74d97b8333cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:13.879450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c126cbd4-f494-46e9-aacf-74d97b8333cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:13.890327 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c126cbd4-f494-46e9-aacf-74d97b8333cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:13.891055 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c126cbd4-f494-46e9-aacf-74d97b8333cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:13.892255 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c126cbd4-f494-46e9-aacf-74d97b8333cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:13.892703 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c126cbd4-f494-46e9-aacf-74d97b8333cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:14.034982 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c126cbd4-f494-46e9-aacf-74d97b8333cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:14.045761 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c126cbd4-f494-46e9-aacf-74d97b8333cf tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.173633 Jun 23 17:18:14.046608 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 342/668] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:13 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:14.203700 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4c5d4c85-147e-4f72-a0ca-04fef0c53491 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:14.204861 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4c5d4c85-147e-4f72-a0ca-04fef0c53491 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:14.216352 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4c5d4c85-147e-4f72-a0ca-04fef0c53491 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:14.217189 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4c5d4c85-147e-4f72-a0ca-04fef0c53491 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:14.218511 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4c5d4c85-147e-4f72-a0ca-04fef0c53491 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:14.219238 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4c5d4c85-147e-4f72-a0ca-04fef0c53491 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:14.373699 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4c5d4c85-147e-4f72-a0ca-04fef0c53491 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:14.382514 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4c5d4c85-147e-4f72-a0ca-04fef0c53491 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1756 microversion: 2.1 time: 0.185321 Jun 23 17:18:14.383060 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 327/669] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:14 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:15.067160 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-65266a29-6b4c-4299-9b95-e2e8b1b3acbd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:15.067928 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-65266a29-6b4c-4299-9b95-e2e8b1b3acbd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:15.077033 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-65266a29-6b4c-4299-9b95-e2e8b1b3acbd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:15.077626 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-65266a29-6b4c-4299-9b95-e2e8b1b3acbd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:15.078689 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-65266a29-6b4c-4299-9b95-e2e8b1b3acbd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:15.079255 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-65266a29-6b4c-4299-9b95-e2e8b1b3acbd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:15.217062 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-65266a29-6b4c-4299-9b95-e2e8b1b3acbd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:15.225235 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-65266a29-6b4c-4299-9b95-e2e8b1b3acbd tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.164373 Jun 23 17:18:15.225816 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 343/670] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:15 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:15.399946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5601dfd1-1663-4857-a867-a7f767ab4a74 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:15.400653 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5601dfd1-1663-4857-a867-a7f767ab4a74 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:15.408897 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5601dfd1-1663-4857-a867-a7f767ab4a74 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:15.409413 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5601dfd1-1663-4857-a867-a7f767ab4a74 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:15.410337 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5601dfd1-1663-4857-a867-a7f767ab4a74 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:15.410841 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5601dfd1-1663-4857-a867-a7f767ab4a74 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:15.557237 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5601dfd1-1663-4857-a867-a7f767ab4a74 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:15.567958 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5601dfd1-1663-4857-a867-a7f767ab4a74 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1756 microversion: 2.1 time: 0.172589 Jun 23 17:18:15.568541 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 328/671] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:15 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:16.246839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f2c88833-6c74-47ef-9c1a-5c7283b03178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:16.252772 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f2c88833-6c74-47ef-9c1a-5c7283b03178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:16.263953 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f2c88833-6c74-47ef-9c1a-5c7283b03178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:16.264678 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f2c88833-6c74-47ef-9c1a-5c7283b03178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:16.265994 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f2c88833-6c74-47ef-9c1a-5c7283b03178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:16.266693 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f2c88833-6c74-47ef-9c1a-5c7283b03178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:16.408367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f2c88833-6c74-47ef-9c1a-5c7283b03178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:16.416466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f2c88833-6c74-47ef-9c1a-5c7283b03178 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.176275 Jun 23 17:18:16.417037 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 344/672] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:16 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:16.590842 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e1fe2a1a-63ec-47f0-8b82-b9a4d4ee71b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:16.592285 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e1fe2a1a-63ec-47f0-8b82-b9a4d4ee71b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:16.600640 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e1fe2a1a-63ec-47f0-8b82-b9a4d4ee71b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:16.601087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e1fe2a1a-63ec-47f0-8b82-b9a4d4ee71b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:16.601878 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e1fe2a1a-63ec-47f0-8b82-b9a4d4ee71b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:16.602313 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e1fe2a1a-63ec-47f0-8b82-b9a4d4ee71b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:16.759738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e1fe2a1a-63ec-47f0-8b82-b9a4d4ee71b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:16.768709 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e1fe2a1a-63ec-47f0-8b82-b9a4d4ee71b2 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1756 microversion: 2.1 time: 0.186531 Jun 23 17:18:16.769337 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 329/673] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:16 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:17.438685 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-490dc234-abfe-4526-83c4-58b2e9dc3a05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:17.439732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-490dc234-abfe-4526-83c4-58b2e9dc3a05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:17.450858 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-490dc234-abfe-4526-83c4-58b2e9dc3a05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:17.451623 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-490dc234-abfe-4526-83c4-58b2e9dc3a05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:17.452902 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-490dc234-abfe-4526-83c4-58b2e9dc3a05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:17.453613 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-490dc234-abfe-4526-83c4-58b2e9dc3a05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:17.589212 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-490dc234-abfe-4526-83c4-58b2e9dc3a05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:17.601884 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-490dc234-abfe-4526-83c4-58b2e9dc3a05 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.169478 Jun 23 17:18:17.602695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 345/674] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:17 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:17.787230 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-20565459-4730-4815-8f5a-1fbf388cfee0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:17.787827 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-20565459-4730-4815-8f5a-1fbf388cfee0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:17.795942 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-20565459-4730-4815-8f5a-1fbf388cfee0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:17.796379 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-20565459-4730-4815-8f5a-1fbf388cfee0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:17.797138 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-20565459-4730-4815-8f5a-1fbf388cfee0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:17.797566 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-20565459-4730-4815-8f5a-1fbf388cfee0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:17.952669 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-20565459-4730-4815-8f5a-1fbf388cfee0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:17.961304 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-20565459-4730-4815-8f5a-1fbf388cfee0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1756 microversion: 2.1 time: 0.178703 Jun 23 17:18:17.961997 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 330/675] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:17 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:18.417009 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-efcfc8f2-d325-47ce-bcb0-5968d572f397 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:18.417495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-efcfc8f2-d325-47ce-bcb0-5968d572f397 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:18.424033 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-efcfc8f2-d325-47ce-bcb0-5968d572f397 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:18.424560 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-efcfc8f2-d325-47ce-bcb0-5968d572f397 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:18.425308 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-efcfc8f2-d325-47ce-bcb0-5968d572f397 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:18.425761 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-efcfc8f2-d325-47ce-bcb0-5968d572f397 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:18.454385 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-efcfc8f2-d325-47ce-bcb0-5968d572f397 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811/ips" status: 200 len: 149 microversion: 2.1 time: 0.174005 Jun 23 17:18:18.455083 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 346/676] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 23 17:18:18 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811/ips => generated 149 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:18:18.466174 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ea801643-36bd-4b8a-886e-56e49c718151 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32efacb9-dbee-426c-83c8-50a630dc2d8e"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:18.467416 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ea801643-36bd-4b8a-886e-56e49c718151 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:18.474128 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ea801643-36bd-4b8a-886e-56e49c718151 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:18.474605 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ea801643-36bd-4b8a-886e-56e49c718151 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:18.479018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ea801643-36bd-4b8a-886e-56e49c718151 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:18.479467 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ea801643-36bd-4b8a-886e-56e49c718151 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:18.561785 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-ea801643-36bd-4b8a-886e-56e49c718151 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] HTTP exception thrown: Invalid volume: volume 32efacb9-dbee-426c-83c8-50a630dc2d8e is already attached to instances: c4d75741-4c24-4377-baeb-d11dc232c879 Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ea801643-36bd-4b8a-886e-56e49c718151 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Request method failure captured: Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: POST /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811/os-volume_attachments HTTP/1.1 Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 74 Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ7iwY6C5zaqNRYLxueUq43muN0MHe54Fc4Vi8vUs_FNvBOzPmyPl2Y8AX6pFx2OI3hqvDvcKTZrFu8kIfpY_ykWG-5HAqbUcRHhG3HFFYy7PKAmD1gcfEdkk0kUs8MeaKA3KSx5FzNY4j9As2Ih8lkR3_iOjjcRNTH7mXCIBr57mgM Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:18:18.563553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:18:18.565169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_201cf53eaff642e78cf394182b0b9972", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}] Jun 23 17:18:18.565169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:18:18.565169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:18:18.565169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:18:18.565169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:18:18.565169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:18:18.565169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:18:18.565169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: fc6a4d6c1f834720a69ee30d5ae63cc9 Jun 23 17:18:18.565169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:18:18.565169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Jun 23 17:18:18.565169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {"volumeAttachment": {"volumeId": "32efacb9-dbee-426c-83c8-50a630dc2d8e"}} Jun 23 17:18:18.565169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Invalid volume: volume 32efacb9-dbee-426c-83c8-50a630dc2d8e is already attached to instances: c4d75741-4c24-4377-baeb-d11dc232c879 Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'server_id': 'a5991769-2ad6-41ff-a83c-2164828f7811', 'body': {'volumeAttachment': {'volumeId': '32efacb9-dbee-426c-83c8-50a630dc2d8e'}}} Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 32efacb9-dbee-426c-83c8-50a630dc2d8e is already attached to instances: c4d75741-4c24-4377-baeb-d11dc232c879 Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:18.566056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 32efacb9-dbee-426c-83c8-50a630dc2d8e is already attached to instances: c4d75741-4c24-4377-baeb-d11dc232c879 Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:18:18.567317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:18:18.568544 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:18:18.568544 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:18:18.568544 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:18:18.568544 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 32efacb9-dbee-426c-83c8-50a630dc2d8e is already attached to instances: c4d75741-4c24-4377-baeb-d11dc232c879 Jun 23 17:18:18.568544 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:18.568544 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ea801643-36bd-4b8a-886e-56e49c718151 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Returning 400 to user: Invalid volume: volume 32efacb9-dbee-426c-83c8-50a630dc2d8e is already attached to instances: c4d75741-4c24-4377-baeb-d11dc232c879 {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:18:18.568544 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ea801643-36bd-4b8a-886e-56e49c718151 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "POST /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102956 Jun 23 17:18:18.568544 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 331/677] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 23 17:18:18 2022] POST /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 17:18:18.574175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-10156d1f-ccf1-4523-9601-b59c900ef091 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:18.574660 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-10156d1f-ccf1-4523-9601-b59c900ef091 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:18.580861 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-10156d1f-ccf1-4523-9601-b59c900ef091 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:18.581299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-10156d1f-ccf1-4523-9601-b59c900ef091 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:18.582079 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-10156d1f-ccf1-4523-9601-b59c900ef091 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:18.582504 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-10156d1f-ccf1-4523-9601-b59c900ef091 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:18.607988 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-10156d1f-ccf1-4523-9601-b59c900ef091 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Going to try to terminate instance {{(pid=117897) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:18:18.619389 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-43f38ffe-232d-4054-87c4-984b0ddc4b62 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:18.620008 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-43f38ffe-232d-4054-87c4-984b0ddc4b62 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:18.626528 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43f38ffe-232d-4054-87c4-984b0ddc4b62 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:18.626981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43f38ffe-232d-4054-87c4-984b0ddc4b62 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:18.627834 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43f38ffe-232d-4054-87c4-984b0ddc4b62 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:18.628372 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43f38ffe-232d-4054-87c4-984b0ddc4b62 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:18.694806 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-10156d1f-ccf1-4523-9601-b59c900ef091 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 204 len: 0 microversion: 2.1 time: 0.124141 Jun 23 17:18:18.695390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 347/678] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:18:18 2022] DELETE /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 17:18:18.703853 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b8cd372d-dffd-4bb4-8d5d-47773af7f7fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:18.704670 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b8cd372d-dffd-4bb4-8d5d-47773af7f7fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:18.711262 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b8cd372d-dffd-4bb4-8d5d-47773af7f7fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:18.711717 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b8cd372d-dffd-4bb4-8d5d-47773af7f7fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:18.712489 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b8cd372d-dffd-4bb4-8d5d-47773af7f7fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:18.712978 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b8cd372d-dffd-4bb4-8d5d-47773af7f7fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:18.778632 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-43f38ffe-232d-4054-87c4-984b0ddc4b62 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:18.787126 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-43f38ffe-232d-4054-87c4-984b0ddc4b62 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.171571 Jun 23 17:18:18.787681 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 332/679] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:18 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:18.845022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b8cd372d-dffd-4bb4-8d5d-47773af7f7fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:18.852925 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b8cd372d-dffd-4bb4-8d5d-47773af7f7fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1680 microversion: 2.1 time: 0.153145 Jun 23 17:18:18.853487 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 348/680] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:18 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:18.986384 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-79526017-7426-430b-be8e-8a1a8caaced5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:18.987349 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-79526017-7426-430b-be8e-8a1a8caaced5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:18.994733 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79526017-7426-430b-be8e-8a1a8caaced5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:18.995197 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79526017-7426-430b-be8e-8a1a8caaced5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:18.996013 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79526017-7426-430b-be8e-8a1a8caaced5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:18.996458 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79526017-7426-430b-be8e-8a1a8caaced5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:19.152073 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-79526017-7426-430b-be8e-8a1a8caaced5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:19.160113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-79526017-7426-430b-be8e-8a1a8caaced5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1756 microversion: 2.1 time: 0.180269 Jun 23 17:18:19.160676 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 333/681] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:18 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:19.807076 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-84e98201-63a8-4413-b9d6-89e38bc18a3a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:19.807703 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-84e98201-63a8-4413-b9d6-89e38bc18a3a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:19.815720 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-84e98201-63a8-4413-b9d6-89e38bc18a3a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:19.816333 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-84e98201-63a8-4413-b9d6-89e38bc18a3a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:19.817176 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-84e98201-63a8-4413-b9d6-89e38bc18a3a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:19.817656 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-84e98201-63a8-4413-b9d6-89e38bc18a3a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:19.822496 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:19.870557 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e687d120-766c-4aa4-a58c-7871099ffc76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:19.871226 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e687d120-766c-4aa4-a58c-7871099ffc76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:19.877563 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e687d120-766c-4aa4-a58c-7871099ffc76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:19.878053 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e687d120-766c-4aa4-a58c-7871099ffc76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:19.878814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e687d120-766c-4aa4-a58c-7871099ffc76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:19.879240 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e687d120-766c-4aa4-a58c-7871099ffc76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:19.883395 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:19.957820 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-84e98201-63a8-4413-b9d6-89e38bc18a3a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:19.966334 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-84e98201-63a8-4413-b9d6-89e38bc18a3a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.164084 Jun 23 17:18:19.966951 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 349/682] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:19 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:20.012996 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e687d120-766c-4aa4-a58c-7871099ffc76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:20.021198 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e687d120-766c-4aa4-a58c-7871099ffc76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1680 microversion: 2.1 time: 0.154559 Jun 23 17:18:20.021761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 334/683] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:19 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:18:20.180668 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ff4f135e-7a88-458b-9e5f-ac0400768d73 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:20.182197 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ff4f135e-7a88-458b-9e5f-ac0400768d73 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:20.191717 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ff4f135e-7a88-458b-9e5f-ac0400768d73 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:20.192141 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ff4f135e-7a88-458b-9e5f-ac0400768d73 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:20.192948 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ff4f135e-7a88-458b-9e5f-ac0400768d73 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:20.193380 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ff4f135e-7a88-458b-9e5f-ac0400768d73 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:20.337318 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ff4f135e-7a88-458b-9e5f-ac0400768d73 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:20.346015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ff4f135e-7a88-458b-9e5f-ac0400768d73 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1756 microversion: 2.1 time: 0.171969 Jun 23 17:18:20.346601 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 350/684] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:20 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:20.988021 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3d75926a-d777-47e2-aad1-eedcd6825c84 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:20.988920 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3d75926a-d777-47e2-aad1-eedcd6825c84 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:21.000255 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3d75926a-d777-47e2-aad1-eedcd6825c84 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:21.000954 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3d75926a-d777-47e2-aad1-eedcd6825c84 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:21.002260 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3d75926a-d777-47e2-aad1-eedcd6825c84 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:21.002975 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3d75926a-d777-47e2-aad1-eedcd6825c84 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:21.038682 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-48af6220-dbb5-484a-991a-d28a7706dd8f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:21.039798 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-48af6220-dbb5-484a-991a-d28a7706dd8f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:21.046960 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-48af6220-dbb5-484a-991a-d28a7706dd8f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:21.047485 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-48af6220-dbb5-484a-991a-d28a7706dd8f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:21.048259 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-48af6220-dbb5-484a-991a-d28a7706dd8f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:21.048692 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-48af6220-dbb5-484a-991a-d28a7706dd8f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:21.137298 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3d75926a-d777-47e2-aad1-eedcd6825c84 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:21.145517 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3d75926a-d777-47e2-aad1-eedcd6825c84 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.164100 Jun 23 17:18:21.146158 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 335/685] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:20 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:21.179743 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-48af6220-dbb5-484a-991a-d28a7706dd8f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:21.187819 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-48af6220-dbb5-484a-991a-d28a7706dd8f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1680 microversion: 2.1 time: 0.153143 Jun 23 17:18:21.188385 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 351/686] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:21 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:21.364689 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8cb360ab-92af-46f3-a46b-4fffd6cc7da9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:21.365405 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8cb360ab-92af-46f3-a46b-4fffd6cc7da9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:21.372489 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8cb360ab-92af-46f3-a46b-4fffd6cc7da9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:21.373206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8cb360ab-92af-46f3-a46b-4fffd6cc7da9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:21.374058 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8cb360ab-92af-46f3-a46b-4fffd6cc7da9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:21.374710 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8cb360ab-92af-46f3-a46b-4fffd6cc7da9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:21.615095 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8cb360ab-92af-46f3-a46b-4fffd6cc7da9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:21.623662 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8cb360ab-92af-46f3-a46b-4fffd6cc7da9 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1759 microversion: 2.1 time: 0.263686 Jun 23 17:18:21.624244 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 336/687] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:21 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1759 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:22.163231 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-471c6c66-81b6-4bd3-a307-5ebcb0309a93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:22.163977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-471c6c66-81b6-4bd3-a307-5ebcb0309a93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:22.170820 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-471c6c66-81b6-4bd3-a307-5ebcb0309a93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:22.171263 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-471c6c66-81b6-4bd3-a307-5ebcb0309a93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:22.172048 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-471c6c66-81b6-4bd3-a307-5ebcb0309a93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:22.172678 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-471c6c66-81b6-4bd3-a307-5ebcb0309a93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:22.206020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8ee07b6d-fd93-4277-8f13-42abff5caac8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:22.206634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8ee07b6d-fd93-4277-8f13-42abff5caac8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:22.216628 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8ee07b6d-fd93-4277-8f13-42abff5caac8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:22.226382 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8ee07b6d-fd93-4277-8f13-42abff5caac8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:22.227649 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8ee07b6d-fd93-4277-8f13-42abff5caac8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:22.228338 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8ee07b6d-fd93-4277-8f13-42abff5caac8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:22.305455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8ee07b6d-fd93-4277-8f13-42abff5caac8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:22.314156 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8ee07b6d-fd93-4277-8f13-42abff5caac8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1612 microversion: 2.1 time: 0.111930 Jun 23 17:18:22.315106 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 337/688] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:22 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1612 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:18:22.350043 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-471c6c66-81b6-4bd3-a307-5ebcb0309a93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:22.359644 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-471c6c66-81b6-4bd3-a307-5ebcb0309a93 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.200574 Jun 23 17:18:22.360227 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 352/689] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:22 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:22.385786 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-73ac629b-ca7e-40cb-bce7-cbf7d319c953 req-94122cde-a726-4d5c-b02e-1937ca654df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5991769-2ad6-41ff-a83c-2164828f7811", "name": "network-vif-deleted", "tag": "9d5c62e1-bf25-4a83-93de-3d9cfb07d904"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:22.394241 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-73ac629b-ca7e-40cb-bce7-cbf7d319c953 req-94122cde-a726-4d5c-b02e-1937ca654df2 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:22.394680 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-73ac629b-ca7e-40cb-bce7-cbf7d319c953 req-94122cde-a726-4d5c-b02e-1937ca654df2 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:22.406139 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-73ac629b-ca7e-40cb-bce7-cbf7d319c953 req-94122cde-a726-4d5c-b02e-1937ca654df2 service nova] Creating event network-vif-deleted:9d5c62e1-bf25-4a83-93de-3d9cfb07d904 for instance a5991769-2ad6-41ff-a83c-2164828f7811 on hv-cinder-83538 Jun 23 17:18:22.411314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-73ac629b-ca7e-40cb-bce7-cbf7d319c953 req-94122cde-a726-4d5c-b02e-1937ca654df2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094867 Jun 23 17:18:22.412105 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 338/690] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:18:23.332181 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-2e64d80a-1d9d-4c47-accc-5e745efab0f1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:23.333609 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-2e64d80a-1d9d-4c47-accc-5e745efab0f1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:23.342687 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2e64d80a-1d9d-4c47-accc-5e745efab0f1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:23.343120 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2e64d80a-1d9d-4c47-accc-5e745efab0f1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:23.343881 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2e64d80a-1d9d-4c47-accc-5e745efab0f1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:23.344303 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2e64d80a-1d9d-4c47-accc-5e745efab0f1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:23.377546 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a5b4e650-0370-4ea1-b0b5-1f2a55ce2588 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:23.379000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a5b4e650-0370-4ea1-b0b5-1f2a55ce2588 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:23.381097 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2e64d80a-1d9d-4c47-accc-5e745efab0f1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:23.381548 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2e64d80a-1d9d-4c47-accc-5e745efab0f1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:23.382022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-2e64d80a-1d9d-4c47-accc-5e745efab0f1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lazy-loading 'fault' on Instance uuid a5991769-2ad6-41ff-a83c-2164828f7811 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:18:23.386670 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5b4e650-0370-4ea1-b0b5-1f2a55ce2588 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:23.387427 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5b4e650-0370-4ea1-b0b5-1f2a55ce2588 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:23.388566 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5b4e650-0370-4ea1-b0b5-1f2a55ce2588 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:23.389213 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5b4e650-0370-4ea1-b0b5-1f2a55ce2588 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:23.428612 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2e64d80a-1d9d-4c47-accc-5e745efab0f1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:23.438741 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-2e64d80a-1d9d-4c47-accc-5e745efab0f1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 200 len: 1330 microversion: 2.1 time: 0.110622 Jun 23 17:18:23.439462 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 353/691] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:23 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:23.539712 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a5b4e650-0370-4ea1-b0b5-1f2a55ce2588 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:23.548910 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a5b4e650-0370-4ea1-b0b5-1f2a55ce2588 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.176057 Jun 23 17:18:23.549498 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 339/692] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:23 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:24.459839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6a1fb481-0698-4db8-add4-fb2b8789bb76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:24.460678 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6a1fb481-0698-4db8-add4-fb2b8789bb76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:24.471020 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6a1fb481-0698-4db8-add4-fb2b8789bb76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:24.471709 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6a1fb481-0698-4db8-add4-fb2b8789bb76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:24.472873 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6a1fb481-0698-4db8-add4-fb2b8789bb76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:24.473534 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6a1fb481-0698-4db8-add4-fb2b8789bb76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:24.488849 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-6a1fb481-0698-4db8-add4-fb2b8789bb76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] HTTP exception thrown: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6a1fb481-0698-4db8-add4-fb2b8789bb76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Request method failure captured: Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 HTTP/1.1 Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7iwY6C5zaqNRYLxueUq43muN0MHe54Fc4Vi8vUs_FNvBOzPmyPl2Y8AX6pFx2OI3hqvDvcKTZrFu8kIfpY_ykWG-5HAqbUcRHhG3HFFYy7PKAmD1gcfEdkk0kUs8MeaKA3KSx5FzNY4j9As2Ih8lkR3_iOjjcRNTH7mXCIBr57mgM Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:18:24.490547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:18:24.492061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_201cf53eaff642e78cf394182b0b9972", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}] Jun 23 17:18:24.492061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:18:24.492061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:18:24.492061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:18:24.492061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:18:24.492061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:18:24.492061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:18:24.492061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: fc6a4d6c1f834720a69ee30d5ae63cc9 Jun 23 17:18:24.492061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:18:24.492061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:18:24.492061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:18:24.492061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': 'a5991769-2ad6-41ff-a83c-2164828f7811'} Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:18:24.493156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:18:24.494636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:18:24.496149 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6a1fb481-0698-4db8-add4-fb2b8789bb76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Returning 404 to user: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:18:24.496149 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6a1fb481-0698-4db8-add4-fb2b8789bb76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 404 len: 111 microversion: 2.1 time: 0.038341 Jun 23 17:18:24.496149 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 354/693] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:24 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:18:24.500847 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-aa71c03d-99a0-4846-9ce4-976a81ffaebb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '.version_select at 0x7f342dbf1820>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:24.504055 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aa71c03d-99a0-4846-9ce4-976a81ffaebb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [de00d254-95c3-4ddc-acc0-d24c30a0f09b] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 17:18:24.569407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4ea31383-0be7-4289-ad72-37ccd779bbe0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:24.570211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4ea31383-0be7-4289-ad72-37ccd779bbe0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:24.577130 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4ea31383-0be7-4289-ad72-37ccd779bbe0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:24.577605 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4ea31383-0be7-4289-ad72-37ccd779bbe0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:24.578414 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4ea31383-0be7-4289-ad72-37ccd779bbe0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:24.578863 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4ea31383-0be7-4289-ad72-37ccd779bbe0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:24.716637 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4ea31383-0be7-4289-ad72-37ccd779bbe0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:24.724863 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4ea31383-0be7-4289-ad72-37ccd779bbe0 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1737 microversion: 2.1 time: 0.161287 Jun 23 17:18:24.725430 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 355/694] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:24 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:25.517399 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [None req-aa71c03d-99a0-4846-9ce4-976a81ffaebb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [de00d254-95c3-4ddc-acc0-d24c30a0f09b] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40276. Jun 23 17:18:25.543951 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-aa71c03d-99a0-4846-9ce4-976a81ffaebb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-788950638" status: 202 len: 0 microversion: 2.1 time: 1.046960 Jun 23 17:18:25.544525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 340/695] 10.222.0.18 () {58 vars in 1217 bytes} [Thu Jun 23 17:18:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-788950638 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 17:18:25.742418 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a6059440-375d-4a83-b658-ec26bc8cd9c2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:25.743098 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a6059440-375d-4a83-b658-ec26bc8cd9c2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:25.750099 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a6059440-375d-4a83-b658-ec26bc8cd9c2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:25.750630 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a6059440-375d-4a83-b658-ec26bc8cd9c2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:25.751440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a6059440-375d-4a83-b658-ec26bc8cd9c2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:25.751978 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a6059440-375d-4a83-b658-ec26bc8cd9c2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:25.978541 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a6059440-375d-4a83-b658-ec26bc8cd9c2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:25.986831 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a6059440-375d-4a83-b658-ec26bc8cd9c2 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1717 microversion: 2.1 time: 0.248350 Jun 23 17:18:25.987413 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 356/696] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:25 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1717 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:26.043979 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-307e6000-6214-441a-87ad-023debadfce9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:26.044496 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-307e6000-6214-441a-87ad-023debadfce9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:26.051582 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-307e6000-6214-441a-87ad-023debadfce9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:26.052033 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-307e6000-6214-441a-87ad-023debadfce9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:26.052794 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-307e6000-6214-441a-87ad-023debadfce9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:26.053227 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-307e6000-6214-441a-87ad-023debadfce9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:26.175515 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-307e6000-6214-441a-87ad-023debadfce9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] HTTP exception thrown: Cannot 'detach_volume' instance 410f9789-fe14-436c-b928-5e32f1057008 while it is in vm_state rescued Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-307e6000-6214-441a-87ad-023debadfce9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Request method failure captured: Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: DELETE /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-volume_attachments/cec0368b-5e40-4664-b93e-aa42cbb91c35 HTTP/1.1 Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ7mFXjOXoVpVDiV73DGaFoQ40dnVCIjXPuBt-YVKYyPM5lfbg2XseOWz8Hy8BcfTziAeJCIEfOhC6ANWOZDu7-5SMQaZLqZ9xDDe2MVgPKXO2USJmXiOEh-zZV6pl6aHTj4-U_og7W-dNSK8arRGdOb8W5jA06K1NkAAAQv7t6Km7w Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: bec9016d905e4d29b8e7c3f63c8a8810 Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:18:26.177122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:18:26.178806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bec9016d905e4d29b8e7c3f63c8a8810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bec9016d905e4d29b8e7c3f63c8a8810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bec9016d905e4d29b8e7c3f63c8a8810", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bec9016d905e4d29b8e7c3f63c8a8810"}]}] Jun 23 17:18:26.178806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:18:26.178806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: bec9016d905e4d29b8e7c3f63c8a8810 Jun 23 17:18:26.178806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:18:26.178806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-ServerRescueNegativeTestJSON-1610712579-project Jun 23 17:18:26.178806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:18:26.178806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:18:26.178806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: ccfccebbea724eca8909be4fea93a58f Jun 23 17:18:26.178806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1610712579-project Jun 23 17:18:26.178806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:18:26.178806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Cannot 'detach_volume' instance 410f9789-fe14-436c-b928-5e32f1057008 while it is in vm_state rescued Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'server_id': '410f9789-fe14-436c-b928-5e32f1057008', 'id': 'cec0368b-5e40-4664-b93e-aa42cbb91c35'} Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 410f9789-fe14-436c-b928-5e32f1057008 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:18:26.180150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 410f9789-fe14-436c-b928-5e32f1057008 while it is in vm_state rescued Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 410f9789-fe14-436c-b928-5e32f1057008 while it is in vm_state rescued Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:26.182144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-307e6000-6214-441a-87ad-023debadfce9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Returning 409 to user: Cannot 'detach_volume' instance 410f9789-fe14-436c-b928-5e32f1057008 while it is in vm_state rescued {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:18:26.184345 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-307e6000-6214-441a-87ad-023debadfce9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "DELETE /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-volume_attachments/cec0368b-5e40-4664-b93e-aa42cbb91c35" status: 409 len: 152 microversion: 2.1 time: 0.138979 Jun 23 17:18:26.184345 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 341/697] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 23 17:18:26 2022] DELETE /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-volume_attachments/cec0368b-5e40-4664-b93e-aa42cbb91c35 => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 17:18:26.188701 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d1a69cb9-5d85-436d-a6fc-940ffd4b417e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:26.189261 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d1a69cb9-5d85-436d-a6fc-940ffd4b417e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:26.195331 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d1a69cb9-5d85-436d-a6fc-940ffd4b417e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:26.195704 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d1a69cb9-5d85-436d-a6fc-940ffd4b417e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:26.196696 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d1a69cb9-5d85-436d-a6fc-940ffd4b417e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:26.197045 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d1a69cb9-5d85-436d-a6fc-940ffd4b417e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:26.270807 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d1a69cb9-5d85-436d-a6fc-940ffd4b417e tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "POST /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/action" status: 202 len: 0 microversion: 2.1 time: 0.085625 Jun 23 17:18:26.271655 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 357/698] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 23 17:18:26 2022] POST /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 17:18:26.280190 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-916d63b2-6696-400e-862a-566b18a588fb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:26.280805 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-916d63b2-6696-400e-862a-566b18a588fb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:26.291128 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-916d63b2-6696-400e-862a-566b18a588fb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:26.291581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-916d63b2-6696-400e-862a-566b18a588fb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:26.292362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-916d63b2-6696-400e-862a-566b18a588fb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:26.292793 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-916d63b2-6696-400e-862a-566b18a588fb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:26.374957 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9db2696f-3d39-4d54-b0cc-7d0acffc97d9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:26.375569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9db2696f-3d39-4d54-b0cc-7d0acffc97d9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:26.382071 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9db2696f-3d39-4d54-b0cc-7d0acffc97d9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:26.382532 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9db2696f-3d39-4d54-b0cc-7d0acffc97d9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:26.383300 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9db2696f-3d39-4d54-b0cc-7d0acffc97d9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:26.383734 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9db2696f-3d39-4d54-b0cc-7d0acffc97d9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:26.511022 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-916d63b2-6696-400e-862a-566b18a588fb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:26.513589 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-9db2696f-3d39-4d54-b0cc-7d0acffc97d9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lazy-loading 'services' on Instance uuid c4d75741-4c24-4377-baeb-d11dc232c879 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:18:26.520226 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-916d63b2-6696-400e-862a-566b18a588fb tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1725 microversion: 2.1 time: 0.244139 Jun 23 17:18:26.521047 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 342/699] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:26 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:26.642501 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9db2696f-3d39-4d54-b0cc-7d0acffc97d9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/os-volume_attachments/32efacb9-dbee-426c-83c8-50a630dc2d8e" status: 202 len: 0 microversion: 2.1 time: 0.271692 Jun 23 17:18:26.643089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 358/700] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 23 17:18:26 2022] DELETE /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/os-volume_attachments/32efacb9-dbee-426c-83c8-50a630dc2d8e => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:18:26.651918 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-045eba39-bfcc-4a35-b42c-045fb8767a6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:26.657701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-045eba39-bfcc-4a35-b42c-045fb8767a6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:26.659993 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-045eba39-bfcc-4a35-b42c-045fb8767a6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:26.660475 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-045eba39-bfcc-4a35-b42c-045fb8767a6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:26.661515 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-045eba39-bfcc-4a35-b42c-045fb8767a6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:26.662053 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-045eba39-bfcc-4a35-b42c-045fb8767a6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:26.698018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-045eba39-bfcc-4a35-b42c-045fb8767a6c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049473 Jun 23 17:18:26.698596 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 343/701] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:18:26 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:18:27.542843 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fc5ed78a-b278-42ac-b4c0-91cb6d3fcfff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:27.543614 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fc5ed78a-b278-42ac-b4c0-91cb6d3fcfff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:27.551601 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc5ed78a-b278-42ac-b4c0-91cb6d3fcfff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:27.552095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc5ed78a-b278-42ac-b4c0-91cb6d3fcfff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:27.552941 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc5ed78a-b278-42ac-b4c0-91cb6d3fcfff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:27.553422 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc5ed78a-b278-42ac-b4c0-91cb6d3fcfff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:27.691536 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-fc5ed78a-b278-42ac-b4c0-91cb6d3fcfff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:27.698898 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-fc5ed78a-b278-42ac-b4c0-91cb6d3fcfff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1725 microversion: 2.1 time: 0.163289 Jun 23 17:18:27.699464 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 359/702] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:27 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:27.708782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f2368fcf-97cd-4a8a-bd05-c46392fb94a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:27.709709 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f2368fcf-97cd-4a8a-bd05-c46392fb94a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:27.717863 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2368fcf-97cd-4a8a-bd05-c46392fb94a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:27.718479 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2368fcf-97cd-4a8a-bd05-c46392fb94a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:27.719252 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2368fcf-97cd-4a8a-bd05-c46392fb94a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:27.719683 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2368fcf-97cd-4a8a-bd05-c46392fb94a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:27.751546 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f2368fcf-97cd-4a8a-bd05-c46392fb94a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046815 Jun 23 17:18:27.752109 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 344/703] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:18:27 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:18:28.718670 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b026daf4-b56e-4600-8ce3-914c7a808781 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:28.719246 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b026daf4-b56e-4600-8ce3-914c7a808781 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:28.726750 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b026daf4-b56e-4600-8ce3-914c7a808781 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:28.727201 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b026daf4-b56e-4600-8ce3-914c7a808781 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:28.727955 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b026daf4-b56e-4600-8ce3-914c7a808781 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:28.728500 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b026daf4-b56e-4600-8ce3-914c7a808781 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:28.763702 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a7ffcd9b-4b5e-4857-8af4-f3027bd5dce7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:28.764653 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a7ffcd9b-4b5e-4857-8af4-f3027bd5dce7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:28.767182 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:28.772872 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7ffcd9b-4b5e-4857-8af4-f3027bd5dce7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:28.773311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7ffcd9b-4b5e-4857-8af4-f3027bd5dce7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:28.774105 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7ffcd9b-4b5e-4857-8af4-f3027bd5dce7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:28.774535 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7ffcd9b-4b5e-4857-8af4-f3027bd5dce7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:28.807121 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a7ffcd9b-4b5e-4857-8af4-f3027bd5dce7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046874 Jun 23 17:18:28.810849 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 345/704] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:18:28 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:18:28.864998 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b026daf4-b56e-4600-8ce3-914c7a808781 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:28.873335 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b026daf4-b56e-4600-8ce3-914c7a808781 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1725 microversion: 2.1 time: 0.158797 Jun 23 17:18:28.873936 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 360/705] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:28 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:29.819043 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e969cb42-155d-410a-bd5f-adc4946fa1ad tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:29.819983 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e969cb42-155d-410a-bd5f-adc4946fa1ad tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:29.827330 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e969cb42-155d-410a-bd5f-adc4946fa1ad tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:29.827772 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e969cb42-155d-410a-bd5f-adc4946fa1ad tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:29.828533 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e969cb42-155d-410a-bd5f-adc4946fa1ad tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:29.828966 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e969cb42-155d-410a-bd5f-adc4946fa1ad tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:29.860122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e969cb42-155d-410a-bd5f-adc4946fa1ad tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045181 Jun 23 17:18:29.860687 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 346/706] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:18:29 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 17:18:29.891217 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5fdc2f03-dfb0-47f8-aaf9-f38c5d89a640 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:29.891849 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5fdc2f03-dfb0-47f8-aaf9-f38c5d89a640 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:29.899503 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5fdc2f03-dfb0-47f8-aaf9-f38c5d89a640 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:29.900035 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5fdc2f03-dfb0-47f8-aaf9-f38c5d89a640 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:29.901074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5fdc2f03-dfb0-47f8-aaf9-f38c5d89a640 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:29.901522 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5fdc2f03-dfb0-47f8-aaf9-f38c5d89a640 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:29.924763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-331e4c63-a5ba-4fa1-b853-56b65b62f7c9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:29.925277 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-331e4c63-a5ba-4fa1-b853-56b65b62f7c9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:29.931820 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-331e4c63-a5ba-4fa1-b853-56b65b62f7c9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:29.932259 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-331e4c63-a5ba-4fa1-b853-56b65b62f7c9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:29.933013 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-331e4c63-a5ba-4fa1-b853-56b65b62f7c9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:29.933435 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-331e4c63-a5ba-4fa1-b853-56b65b62f7c9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:29.958459 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-331e4c63-a5ba-4fa1-b853-56b65b62f7c9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:18:30.036112 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5fdc2f03-dfb0-47f8-aaf9-f38c5d89a640 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:30.043337 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-331e4c63-a5ba-4fa1-b853-56b65b62f7c9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 204 len: 0 microversion: 2.1 time: 0.122204 Jun 23 17:18:30.044139 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 347/707] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:18:29 2022] DELETE /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 17:18:30.044277 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5fdc2f03-dfb0-47f8-aaf9-f38c5d89a640 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1731 microversion: 2.1 time: 0.157479 Jun 23 17:18:30.044963 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 361/708] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:29 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:30.052721 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7338bc6d-e8e4-44e7-a33a-a77df26599b5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:30.053413 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7338bc6d-e8e4-44e7-a33a-a77df26599b5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:30.061250 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7338bc6d-e8e4-44e7-a33a-a77df26599b5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:30.061363 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-cd0cc13f-d233-4052-9d4e-e4d24f0294ff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:30.061506 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7338bc6d-e8e4-44e7-a33a-a77df26599b5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:30.061609 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-cd0cc13f-d233-4052-9d4e-e4d24f0294ff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:30.062099 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7338bc6d-e8e4-44e7-a33a-a77df26599b5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:30.062534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7338bc6d-e8e4-44e7-a33a-a77df26599b5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:30.067465 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cd0cc13f-d233-4052-9d4e-e4d24f0294ff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:30.067901 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cd0cc13f-d233-4052-9d4e-e4d24f0294ff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:30.068846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cd0cc13f-d233-4052-9d4e-e4d24f0294ff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:30.069276 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cd0cc13f-d233-4052-9d4e-e4d24f0294ff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:30.146880 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-cd0cc13f-d233-4052-9d4e-e4d24f0294ff tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089822 Jun 23 17:18:30.147467 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 362/709] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 23 17:18:30 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:18:30.194904 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7338bc6d-e8e4-44e7-a33a-a77df26599b5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:30.202786 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7338bc6d-e8e4-44e7-a33a-a77df26599b5 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1680 microversion: 2.1 time: 0.154470 Jun 23 17:18:30.203365 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 348/710] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:30 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:18:31.220599 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e8f3a01a-75d9-4a6f-b1eb-17df76c4754e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:31.221294 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e8f3a01a-75d9-4a6f-b1eb-17df76c4754e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:31.227533 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e8f3a01a-75d9-4a6f-b1eb-17df76c4754e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:31.227983 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e8f3a01a-75d9-4a6f-b1eb-17df76c4754e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:31.228819 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e8f3a01a-75d9-4a6f-b1eb-17df76c4754e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:31.229254 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e8f3a01a-75d9-4a6f-b1eb-17df76c4754e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:31.451044 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e8f3a01a-75d9-4a6f-b1eb-17df76c4754e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:31.460726 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e8f3a01a-75d9-4a6f-b1eb-17df76c4754e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1680 microversion: 2.1 time: 0.244666 Jun 23 17:18:31.462158 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 363/711] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:31 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:31.533893 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-f9212777-0e48-4d74-9c28-ff43541247b0 req-e404fce0-10a2-4c61-b5dd-23c468ea0372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410f9789-fe14-436c-b928-5e32f1057008", "tag": "3cb62c73-34be-4c1e-ac1b-34d0ab60dbbf"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:31.543109 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-f9212777-0e48-4d74-9c28-ff43541247b0 req-e404fce0-10a2-4c61-b5dd-23c468ea0372 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:31.543543 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-f9212777-0e48-4d74-9c28-ff43541247b0 req-e404fce0-10a2-4c61-b5dd-23c468ea0372 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:31.554618 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-f9212777-0e48-4d74-9c28-ff43541247b0 req-e404fce0-10a2-4c61-b5dd-23c468ea0372 service nova] Creating event network-changed:3cb62c73-34be-4c1e-ac1b-34d0ab60dbbf for instance 410f9789-fe14-436c-b928-5e32f1057008 on hv-cinder-83538 Jun 23 17:18:31.560830 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-f9212777-0e48-4d74-9c28-ff43541247b0 req-e404fce0-10a2-4c61-b5dd-23c468ea0372 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087878 Jun 23 17:18:31.561896 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 349/712] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:18:32.479240 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f09f4dea-a7e4-482a-8d88-05effe7598fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:32.479953 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f09f4dea-a7e4-482a-8d88-05effe7598fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:32.487123 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f09f4dea-a7e4-482a-8d88-05effe7598fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:32.487571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f09f4dea-a7e4-482a-8d88-05effe7598fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:32.488427 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f09f4dea-a7e4-482a-8d88-05effe7598fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:32.488864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f09f4dea-a7e4-482a-8d88-05effe7598fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:32.556671 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f09f4dea-a7e4-482a-8d88-05effe7598fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:32.560410 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:32.564874 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f09f4dea-a7e4-482a-8d88-05effe7598fb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 200 len: 1613 microversion: 2.1 time: 0.090206 Jun 23 17:18:32.565440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 364/713] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:32 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:32.669354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-a88c995f-7d11-45a4-bab3-8a45d49ddbce req-f7da6128-927e-46f1-b3e7-af2f92a055fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d75741-4c24-4377-baeb-d11dc232c879", "name": "network-vif-deleted", "tag": "30b1cac9-5302-4079-b5e0-7137567b16e5"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:32.682200 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-a88c995f-7d11-45a4-bab3-8a45d49ddbce req-f7da6128-927e-46f1-b3e7-af2f92a055fe service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:32.683074 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-a88c995f-7d11-45a4-bab3-8a45d49ddbce req-f7da6128-927e-46f1-b3e7-af2f92a055fe service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:32.702115 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-a88c995f-7d11-45a4-bab3-8a45d49ddbce req-f7da6128-927e-46f1-b3e7-af2f92a055fe service nova] Creating event network-vif-deleted:30b1cac9-5302-4079-b5e0-7137567b16e5 for instance c4d75741-4c24-4377-baeb-d11dc232c879 on hv-cinder-83538 Jun 23 17:18:32.709452 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-a88c995f-7d11-45a4-bab3-8a45d49ddbce req-f7da6128-927e-46f1-b3e7-af2f92a055fe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047259 Jun 23 17:18:32.712550 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 350/714] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:18:32.964924 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6d36dd9a-c33a-4706-bd60-61366757ceca tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:32.965605 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6d36dd9a-c33a-4706-bd60-61366757ceca tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:32.973516 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6d36dd9a-c33a-4706-bd60-61366757ceca tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:32.973995 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6d36dd9a-c33a-4706-bd60-61366757ceca tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:32.974766 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6d36dd9a-c33a-4706-bd60-61366757ceca tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:32.975201 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6d36dd9a-c33a-4706-bd60-61366757ceca tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:32.999482 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-6d36dd9a-c33a-4706-bd60-61366757ceca tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lazy-loading 'flavor' on Instance uuid 4eed0594-b0c2-4c93-a04b-898a6e02ca06 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:18:33.076348 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6d36dd9a-c33a-4706-bd60-61366757ceca tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "POST /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06/action" status: 202 len: 0 microversion: 2.1 time: 0.115383 Jun 23 17:18:33.077067 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 365/715] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 23 17:18:32 2022] POST /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:18:33.086297 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3cabda3b-86f1-48e1-b428-ca01a043b317 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:33.086988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3cabda3b-86f1-48e1-b428-ca01a043b317 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:33.093889 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3cabda3b-86f1-48e1-b428-ca01a043b317 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:33.094329 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3cabda3b-86f1-48e1-b428-ca01a043b317 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:33.095083 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3cabda3b-86f1-48e1-b428-ca01a043b317 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:33.095512 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3cabda3b-86f1-48e1-b428-ca01a043b317 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:33.233432 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3cabda3b-86f1-48e1-b428-ca01a043b317 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:33.241251 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3cabda3b-86f1-48e1-b428-ca01a043b317 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1568 microversion: 2.1 time: 0.159236 Jun 23 17:18:33.241864 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 351/716] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:33 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:33.576432 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-a5c5ed65-674d-4835-90f2-82e2b882ca03 req-fea781a2-063a-4b32-a6f4-2ec1065da25b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410f9789-fe14-436c-b928-5e32f1057008", "tag": "3cb62c73-34be-4c1e-ac1b-34d0ab60dbbf"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:33.582874 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-67fd55c3-1eda-461f-8045-9be056cfa624 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:33.583491 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-67fd55c3-1eda-461f-8045-9be056cfa624 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:33.584886 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-a5c5ed65-674d-4835-90f2-82e2b882ca03 req-fea781a2-063a-4b32-a6f4-2ec1065da25b service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:33.585342 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-a5c5ed65-674d-4835-90f2-82e2b882ca03 req-fea781a2-063a-4b32-a6f4-2ec1065da25b service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:33.593358 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67fd55c3-1eda-461f-8045-9be056cfa624 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:33.594279 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67fd55c3-1eda-461f-8045-9be056cfa624 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:33.595669 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67fd55c3-1eda-461f-8045-9be056cfa624 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:33.596563 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67fd55c3-1eda-461f-8045-9be056cfa624 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:33.597816 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-a5c5ed65-674d-4835-90f2-82e2b882ca03 req-fea781a2-063a-4b32-a6f4-2ec1065da25b service nova] Creating event network-changed:3cb62c73-34be-4c1e-ac1b-34d0ab60dbbf for instance 410f9789-fe14-436c-b928-5e32f1057008 on hv-cinder-83538 Jun 23 17:18:33.603142 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-a5c5ed65-674d-4835-90f2-82e2b882ca03 req-fea781a2-063a-4b32-a6f4-2ec1065da25b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031261 Jun 23 17:18:33.603860 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 366/717] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:18:33.605424 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:33.617083 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-67fd55c3-1eda-461f-8045-9be056cfa624 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] HTTP exception thrown: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-67fd55c3-1eda-461f-8045-9be056cfa624 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Request method failure captured: Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 HTTP/1.1 Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ7iwY6C5zaqNRYLxueUq43muN0MHe54Fc4Vi8vUs_FNvBOzPmyPl2Y8AX6pFx2OI3hqvDvcKTZrFu8kIfpY_ykWG-5HAqbUcRHhG3HFFYy7PKAmD1gcfEdkk0kUs8MeaKA3KSx5FzNY4j9As2Ih8lkR3_iOjjcRNTH7mXCIBr57mgM Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:18:33.619012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:18:33.620583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_201cf53eaff642e78cf394182b0b9972", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}] Jun 23 17:18:33.620583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:18:33.620583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:18:33.620583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:18:33.620583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:18:33.620583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:18:33.620583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:18:33.620583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: fc6a4d6c1f834720a69ee30d5ae63cc9 Jun 23 17:18:33.620583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:18:33.620583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:18:33.620583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:18:33.620583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': 'c4d75741-4c24-4377-baeb-d11dc232c879'} Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:18:33.621455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:18:33.622901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:18:33.624237 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-67fd55c3-1eda-461f-8045-9be056cfa624 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Returning 404 to user: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:18:33.624237 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-67fd55c3-1eda-461f-8045-9be056cfa624 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 404 len: 111 microversion: 2.1 time: 0.042150 Jun 23 17:18:33.625779 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 352/718] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:33 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 17:18:33.631079 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b93264d2-6391-42d3-bb7f-6ed7f5edc479 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '.version_select at 0x7f342dbd4700>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:33.652579 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b93264d2-6391-42d3-bb7f-6ed7f5edc479 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542390084" status: 202 len: 0 microversion: 2.1 time: 0.026280 Jun 23 17:18:33.653443 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 367/719] 10.222.0.18 () {58 vars in 1220 bytes} [Thu Jun 23 17:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542390084 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:18:34.259718 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1ff1d4f1-e209-4cdf-a358-c14cf0307d39 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:34.260416 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1ff1d4f1-e209-4cdf-a358-c14cf0307d39 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:34.268442 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1ff1d4f1-e209-4cdf-a358-c14cf0307d39 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:34.268983 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1ff1d4f1-e209-4cdf-a358-c14cf0307d39 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:34.269744 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1ff1d4f1-e209-4cdf-a358-c14cf0307d39 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:34.270210 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1ff1d4f1-e209-4cdf-a358-c14cf0307d39 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:34.291854 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4ae991ce-2967-4ef9-98f9-21cd2581bd80 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Action: 'create', calling method: .version_select at 0x7f342dc0caf0>, body: {"keypair": {"name": "tempest-keypair-333792519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJe5DRptdrJlhrT+xoqB34hpHmJ4nCtx6k6X1tPDw3BcWSG6nH6aKz3N3gJK/eATDhyNgzhl8szIksJtdElMLVT8UbB5p09prpwxI1in03vSapM6+p4nmUKrXNekbOHqqw=="}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:34.307374 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-4ae991ce-2967-4ef9-98f9-21cd2581bd80 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for project 201cf53eaff642e78cf394182b0b9972. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:18:34.311373 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-4ae991ce-2967-4ef9-98f9-21cd2581bd80 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for user fc6a4d6c1f834720a69ee30d5ae63cc9 and project 201cf53eaff642e78cf394182b0b9972. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:18:34.334350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4ae991ce-2967-4ef9-98f9-21cd2581bd80 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046805 Jun 23 17:18:34.335405 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 368/720] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 23 17:18:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:18:34.409426 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1ff1d4f1-e209-4cdf-a358-c14cf0307d39 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:34.417064 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1ff1d4f1-e209-4cdf-a358-c14cf0307d39 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1568 microversion: 2.1 time: 0.161523 Jun 23 17:18:34.417643 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 353/721] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:34 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:35.435283 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d5e86377-0d78-4e6e-8329-3d859ed136b4 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:35.436008 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d5e86377-0d78-4e6e-8329-3d859ed136b4 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:35.442423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d5e86377-0d78-4e6e-8329-3d859ed136b4 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:35.442849 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d5e86377-0d78-4e6e-8329-3d859ed136b4 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:35.443602 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d5e86377-0d78-4e6e-8329-3d859ed136b4 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:35.444025 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d5e86377-0d78-4e6e-8329-3d859ed136b4 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:35.583953 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d5e86377-0d78-4e6e-8329-3d859ed136b4 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:35.591820 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d5e86377-0d78-4e6e-8329-3d859ed136b4 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1568 microversion: 2.1 time: 0.160902 Jun 23 17:18:35.592367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 369/722] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:35 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:35.620735 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1001912964", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3cd0a13-7d3d-4379-9bdb-f7a035d3d8b1"}], "security_groups": [{"name": "tempest-securitygroup--43789590"}], "key_name": "tempest-keypair-333792519", "user_data": "}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:35.724831 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] validate_networks() for [('a3cd0a13-7d3d-4379-9bdb-f7a035d3d8b1', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:18:36.178072 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:18:36.178539 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:18:36.179196 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:18:36.179598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:18:36.180073 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:18:36.190309 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:36.190750 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:36.191537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:36.191959 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:36.209237 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for project 201cf53eaff642e78cf394182b0b9972. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:18:36.213596 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for user fc6a4d6c1f834720a69ee30d5ae63cc9 and project 201cf53eaff642e78cf394182b0b9972. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:18:36.225823 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:18:36.228156 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:18:36.275746 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [11db0d7f-6458-423c-b041-5811016f176a] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 17:18:36.609545 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a5ff3d5e-fdb1-4616-a7f9-535e0d574ca2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:36.610191 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a5ff3d5e-fdb1-4616-a7f9-535e0d574ca2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:36.617385 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a5ff3d5e-fdb1-4616-a7f9-535e0d574ca2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:36.617826 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a5ff3d5e-fdb1-4616-a7f9-535e0d574ca2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:36.618589 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a5ff3d5e-fdb1-4616-a7f9-535e0d574ca2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:36.619073 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a5ff3d5e-fdb1-4616-a7f9-535e0d574ca2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:36.758459 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a5ff3d5e-fdb1-4616-a7f9-535e0d574ca2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:36.766618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a5ff3d5e-fdb1-4616-a7f9-535e0d574ca2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1568 microversion: 2.1 time: 0.161098 Jun 23 17:18:36.767199 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 370/723] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:36 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:18:37.285382 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [11db0d7f-6458-423c-b041-5811016f176a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40388. Jun 23 17:18:37.292032 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e4c65814-45e9-436f-af2b-f4972dfb83e6 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.675695 Jun 23 17:18:37.292692 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 354/724] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:18:35 2022] POST /compute/v2.1/servers => generated 400 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:18:37.302960 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-36a7466c-3da9-4986-9b4c-fe63e9b4180f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:37.303593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-36a7466c-3da9-4986-9b4c-fe63e9b4180f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:37.356822 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-36a7466c-3da9-4986-9b4c-fe63e9b4180f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:37.363882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-36a7466c-3da9-4986-9b4c-fe63e9b4180f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1241 microversion: 2.1 time: 0.064976 Jun 23 17:18:37.364451 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 371/725] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:37 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:37.789640 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-95924eb8-8a40-443b-a01f-eed9e5eda6b2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:37.790738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-95924eb8-8a40-443b-a01f-eed9e5eda6b2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:37.802486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95924eb8-8a40-443b-a01f-eed9e5eda6b2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:37.803209 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95924eb8-8a40-443b-a01f-eed9e5eda6b2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:37.804447 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95924eb8-8a40-443b-a01f-eed9e5eda6b2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:37.805169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95924eb8-8a40-443b-a01f-eed9e5eda6b2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:37.941060 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-95924eb8-8a40-443b-a01f-eed9e5eda6b2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:37.949158 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-95924eb8-8a40-443b-a01f-eed9e5eda6b2 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1568 microversion: 2.1 time: 0.166909 Jun 23 17:18:37.949726 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 355/726] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:37 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:38.381291 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3cc79e29-7fdd-4676-a6e7-e18f97efd40f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:38.381908 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3cc79e29-7fdd-4676-a6e7-e18f97efd40f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:38.384980 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:38.443328 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3cc79e29-7fdd-4676-a6e7-e18f97efd40f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:38.451267 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3cc79e29-7fdd-4676-a6e7-e18f97efd40f tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1241 microversion: 2.1 time: 0.074253 Jun 23 17:18:38.452666 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 372/727] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:38 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:38.971099 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-65a10809-07f8-4626-8f02-d770637f3841 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:38.971961 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-65a10809-07f8-4626-8f02-d770637f3841 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:38.983113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-65a10809-07f8-4626-8f02-d770637f3841 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:38.983844 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-65a10809-07f8-4626-8f02-d770637f3841 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:38.985085 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-65a10809-07f8-4626-8f02-d770637f3841 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:38.986068 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-65a10809-07f8-4626-8f02-d770637f3841 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:39.134561 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-65a10809-07f8-4626-8f02-d770637f3841 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:39.145716 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-65a10809-07f8-4626-8f02-d770637f3841 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1568 microversion: 2.1 time: 0.181105 Jun 23 17:18:39.146507 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 356/728] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:38 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:39.470297 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c644d02d-fd0f-4703-8889-545d3fb9ef35 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:39.470899 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c644d02d-fd0f-4703-8889-545d3fb9ef35 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:39.533105 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c644d02d-fd0f-4703-8889-545d3fb9ef35 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:39.541626 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c644d02d-fd0f-4703-8889-545d3fb9ef35 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1241 microversion: 2.1 time: 0.075874 Jun 23 17:18:39.542235 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 373/729] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:39 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:40.166494 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-da361be1-0f9b-402f-a39c-47dd4f87f138 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:40.167215 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-da361be1-0f9b-402f-a39c-47dd4f87f138 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:40.179572 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da361be1-0f9b-402f-a39c-47dd4f87f138 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:40.180017 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da361be1-0f9b-402f-a39c-47dd4f87f138 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:40.181111 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da361be1-0f9b-402f-a39c-47dd4f87f138 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:40.181623 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da361be1-0f9b-402f-a39c-47dd4f87f138 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:40.329627 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-da361be1-0f9b-402f-a39c-47dd4f87f138 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:40.344157 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-da361be1-0f9b-402f-a39c-47dd4f87f138 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1568 microversion: 2.1 time: 0.182964 Jun 23 17:18:40.345070 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 357/730] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:40 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:40.561506 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9f161252-a11c-447d-ab17-37ecbe7cc8e0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:40.562276 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9f161252-a11c-447d-ab17-37ecbe7cc8e0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:40.620554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9f161252-a11c-447d-ab17-37ecbe7cc8e0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:40.631381 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9f161252-a11c-447d-ab17-37ecbe7cc8e0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1241 microversion: 2.1 time: 0.074988 Jun 23 17:18:40.632129 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 374/731] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:40 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:41.369766 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7ecbdd01-47c5-4c8c-9dcf-60ea8ab03877 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:41.370399 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7ecbdd01-47c5-4c8c-9dcf-60ea8ab03877 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:41.377631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7ecbdd01-47c5-4c8c-9dcf-60ea8ab03877 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:41.378139 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7ecbdd01-47c5-4c8c-9dcf-60ea8ab03877 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:41.378927 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7ecbdd01-47c5-4c8c-9dcf-60ea8ab03877 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:41.379374 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7ecbdd01-47c5-4c8c-9dcf-60ea8ab03877 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:41.526102 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7ecbdd01-47c5-4c8c-9dcf-60ea8ab03877 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:41.537331 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7ecbdd01-47c5-4c8c-9dcf-60ea8ab03877 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1568 microversion: 2.1 time: 0.173703 Jun 23 17:18:41.538166 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 358/732] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:41 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:41.653412 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-324d7c4e-2350-4a44-bad3-0eec8588dbd1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:41.654316 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-324d7c4e-2350-4a44-bad3-0eec8588dbd1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:41.665585 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-324d7c4e-2350-4a44-bad3-0eec8588dbd1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:41.666360 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-324d7c4e-2350-4a44-bad3-0eec8588dbd1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:41.667119 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-324d7c4e-2350-4a44-bad3-0eec8588dbd1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:41.667551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-324d7c4e-2350-4a44-bad3-0eec8588dbd1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:41.728527 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-324d7c4e-2350-4a44-bad3-0eec8588dbd1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:41.736602 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-324d7c4e-2350-4a44-bad3-0eec8588dbd1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1245 microversion: 2.1 time: 0.090273 Jun 23 17:18:41.737171 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 375/733] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:41 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:42.561903 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-30aa944d-68c9-49b4-879b-94c93cfc444b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:42.562545 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-30aa944d-68c9-49b4-879b-94c93cfc444b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:42.570441 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30aa944d-68c9-49b4-879b-94c93cfc444b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:42.571143 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30aa944d-68c9-49b4-879b-94c93cfc444b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:42.572082 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30aa944d-68c9-49b4-879b-94c93cfc444b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:42.572785 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30aa944d-68c9-49b4-879b-94c93cfc444b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:42.753820 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-efeea70b-63da-426f-9e73-e9bae07b825e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:42.754435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-efeea70b-63da-426f-9e73-e9bae07b825e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:42.761514 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-efeea70b-63da-426f-9e73-e9bae07b825e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:42.761962 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-efeea70b-63da-426f-9e73-e9bae07b825e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:42.762755 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-efeea70b-63da-426f-9e73-e9bae07b825e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:42.763190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-efeea70b-63da-426f-9e73-e9bae07b825e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:42.778701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-30aa944d-68c9-49b4-879b-94c93cfc444b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:42.786649 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-30aa944d-68c9-49b4-879b-94c93cfc444b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1568 microversion: 2.1 time: 0.229645 Jun 23 17:18:42.787217 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 359/734] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:42 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:42.828798 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-efeea70b-63da-426f-9e73-e9bae07b825e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:42.836783 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-efeea70b-63da-426f-9e73-e9bae07b825e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1299 microversion: 2.1 time: 0.086838 Jun 23 17:18:42.837480 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 376/735] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:42 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:43.804194 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0b0648e1-bfe2-4db4-adec-87c69ac81b59 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:43.804840 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0b0648e1-bfe2-4db4-adec-87c69ac81b59 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:43.816823 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b0648e1-bfe2-4db4-adec-87c69ac81b59 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:43.817266 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b0648e1-bfe2-4db4-adec-87c69ac81b59 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:43.818061 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b0648e1-bfe2-4db4-adec-87c69ac81b59 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:43.818482 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b0648e1-bfe2-4db4-adec-87c69ac81b59 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:43.855139 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-81493701-9502-44a6-ab81-2f0cce5fa0fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:43.855715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-81493701-9502-44a6-ab81-2f0cce5fa0fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:43.863528 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-81493701-9502-44a6-ab81-2f0cce5fa0fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:43.864101 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-81493701-9502-44a6-ab81-2f0cce5fa0fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:43.865007 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-81493701-9502-44a6-ab81-2f0cce5fa0fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:43.865536 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-81493701-9502-44a6-ab81-2f0cce5fa0fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:44.005226 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-81493701-9502-44a6-ab81-2f0cce5fa0fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:44.013500 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-81493701-9502-44a6-ab81-2f0cce5fa0fc tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1365 microversion: 2.1 time: 0.162513 Jun 23 17:18:44.014123 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 377/736] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:43 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:44.166618 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0b0648e1-bfe2-4db4-adec-87c69ac81b59 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:44.177608 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0b0648e1-bfe2-4db4-adec-87c69ac81b59 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1568 microversion: 2.1 time: 0.376658 Jun 23 17:18:44.178964 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 360/737] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:43 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1568 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:44.756910 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-233074c7-f0dd-4359-84f8-101fc3d52186 req-e913ce57-b7b9-42c9-a91f-86908ef1e694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51605a4b-853e-479f-a3e6-f09880c23d5b", "tag": "bd95943b-1970-4801-a4a2-b918b988ab45"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:44.772342 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-233074c7-f0dd-4359-84f8-101fc3d52186 req-e913ce57-b7b9-42c9-a91f-86908ef1e694 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:44.772783 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-233074c7-f0dd-4359-84f8-101fc3d52186 req-e913ce57-b7b9-42c9-a91f-86908ef1e694 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:44.784328 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-233074c7-f0dd-4359-84f8-101fc3d52186 req-e913ce57-b7b9-42c9-a91f-86908ef1e694 service nova] Creating event network-changed:bd95943b-1970-4801-a4a2-b918b988ab45 for instance 51605a4b-853e-479f-a3e6-f09880c23d5b on hv-cinder-83538 Jun 23 17:18:44.789390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-233074c7-f0dd-4359-84f8-101fc3d52186 req-e913ce57-b7b9-42c9-a91f-86908ef1e694 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044539 Jun 23 17:18:44.790333 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 378/738] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:18:45.030525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0d0c5dcc-c53c-4dbc-9bbd-b9f1619127a9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:45.031102 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0d0c5dcc-c53c-4dbc-9bbd-b9f1619127a9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:45.038131 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d0c5dcc-c53c-4dbc-9bbd-b9f1619127a9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:45.038565 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d0c5dcc-c53c-4dbc-9bbd-b9f1619127a9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:45.039335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d0c5dcc-c53c-4dbc-9bbd-b9f1619127a9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:45.039780 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d0c5dcc-c53c-4dbc-9bbd-b9f1619127a9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:45.179469 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0d0c5dcc-c53c-4dbc-9bbd-b9f1619127a9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:45.187973 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0d0c5dcc-c53c-4dbc-9bbd-b9f1619127a9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1365 microversion: 2.1 time: 0.161405 Jun 23 17:18:45.188545 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 361/739] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:45 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:45.197475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-647893f7-6771-473b-8822-c2ea508d71c9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:45.198394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-647893f7-6771-473b-8822-c2ea508d71c9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:45.204952 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-647893f7-6771-473b-8822-c2ea508d71c9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:45.205427 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-647893f7-6771-473b-8822-c2ea508d71c9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:45.206223 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-647893f7-6771-473b-8822-c2ea508d71c9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:45.206655 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-647893f7-6771-473b-8822-c2ea508d71c9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:45.347724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-647893f7-6771-473b-8822-c2ea508d71c9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:45.356864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-647893f7-6771-473b-8822-c2ea508d71c9 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1568 microversion: 2.1 time: 0.164061 Jun 23 17:18:45.357405 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 379/740] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:45 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:46.204873 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4eab44bf-b53c-4573-89e1-a24e25842e6d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:46.205482 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4eab44bf-b53c-4573-89e1-a24e25842e6d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:46.207911 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:46.213924 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4eab44bf-b53c-4573-89e1-a24e25842e6d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:46.214374 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4eab44bf-b53c-4573-89e1-a24e25842e6d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:46.215177 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4eab44bf-b53c-4573-89e1-a24e25842e6d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:46.215616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4eab44bf-b53c-4573-89e1-a24e25842e6d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:46.220135 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:46.374427 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-55b8bb7c-b86b-4872-a44c-c505bea7ab64 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:46.375247 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-55b8bb7c-b86b-4872-a44c-c505bea7ab64 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:46.383612 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-55b8bb7c-b86b-4872-a44c-c505bea7ab64 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:46.384469 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-55b8bb7c-b86b-4872-a44c-c505bea7ab64 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:46.385784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-55b8bb7c-b86b-4872-a44c-c505bea7ab64 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:46.386537 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-55b8bb7c-b86b-4872-a44c-c505bea7ab64 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:46.389174 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4eab44bf-b53c-4573-89e1-a24e25842e6d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:46.397137 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4eab44bf-b53c-4573-89e1-a24e25842e6d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1365 microversion: 2.1 time: 0.196247 Jun 23 17:18:46.397783 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 362/741] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:46 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:46.523283 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-55b8bb7c-b86b-4872-a44c-c505bea7ab64 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:46.531592 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-55b8bb7c-b86b-4872-a44c-c505bea7ab64 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1568 microversion: 2.1 time: 0.161883 Jun 23 17:18:46.532144 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 380/742] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:46 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:47.418796 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-68dd9666-2a1c-400f-a60c-e7a882e3b825 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:47.419796 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-68dd9666-2a1c-400f-a60c-e7a882e3b825 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:47.430466 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68dd9666-2a1c-400f-a60c-e7a882e3b825 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:47.431742 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68dd9666-2a1c-400f-a60c-e7a882e3b825 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:47.432518 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68dd9666-2a1c-400f-a60c-e7a882e3b825 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:47.432954 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68dd9666-2a1c-400f-a60c-e7a882e3b825 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:47.548789 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-0a0851dd-ce45-4613-9037-b9292b517972 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:47.549388 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-0a0851dd-ce45-4613-9037-b9292b517972 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:47.556785 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0a0851dd-ce45-4613-9037-b9292b517972 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:47.557234 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0a0851dd-ce45-4613-9037-b9292b517972 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:47.558058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0a0851dd-ce45-4613-9037-b9292b517972 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:47.558491 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0a0851dd-ce45-4613-9037-b9292b517972 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:47.566512 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-68dd9666-2a1c-400f-a60c-e7a882e3b825 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:47.574442 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-68dd9666-2a1c-400f-a60c-e7a882e3b825 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1365 microversion: 2.1 time: 0.162498 Jun 23 17:18:47.575012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 363/743] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:47 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:47.697406 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-0a0851dd-ce45-4613-9037-b9292b517972 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:47.705576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-0a0851dd-ce45-4613-9037-b9292b517972 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1569 microversion: 2.1 time: 0.160842 Jun 23 17:18:47.706205 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 381/744] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:47 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:47.722661 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-30530e29-f35d-4137-9875-f0d89e1e32a5 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:47.723225 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-30530e29-f35d-4137-9875-f0d89e1e32a5 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:47.730180 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30530e29-f35d-4137-9875-f0d89e1e32a5 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:47.730626 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30530e29-f35d-4137-9875-f0d89e1e32a5 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:47.731383 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30530e29-f35d-4137-9875-f0d89e1e32a5 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:47.731811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30530e29-f35d-4137-9875-f0d89e1e32a5 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:47.832297 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-30530e29-f35d-4137-9875-f0d89e1e32a5 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "POST /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06/action" status: 202 len: 0 microversion: 2.1 time: 0.113574 Jun 23 17:18:47.832902 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 364/745] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 23 17:18:47 2022] POST /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:18:47.841343 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-0ed38be8-3b5c-422b-aab2-6959742e3d5b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:47.842022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-0ed38be8-3b5c-422b-aab2-6959742e3d5b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:47.848344 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0ed38be8-3b5c-422b-aab2-6959742e3d5b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:47.848788 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0ed38be8-3b5c-422b-aab2-6959742e3d5b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:47.849565 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0ed38be8-3b5c-422b-aab2-6959742e3d5b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:47.850263 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0ed38be8-3b5c-422b-aab2-6959742e3d5b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:47.986210 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-0ed38be8-3b5c-422b-aab2-6959742e3d5b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:47.993887 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-0ed38be8-3b5c-422b-aab2-6959742e3d5b tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1577 microversion: 2.1 time: 0.156533 Jun 23 17:18:47.994452 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 382/746] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:47 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:48.592859 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e9bc10f6-4f22-45a8-96ba-ef376cd75e8a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:48.593477 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e9bc10f6-4f22-45a8-96ba-ef376cd75e8a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:48.602685 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9bc10f6-4f22-45a8-96ba-ef376cd75e8a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:48.603272 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9bc10f6-4f22-45a8-96ba-ef376cd75e8a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:48.604079 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9bc10f6-4f22-45a8-96ba-ef376cd75e8a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:48.604506 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9bc10f6-4f22-45a8-96ba-ef376cd75e8a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:48.758289 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e9bc10f6-4f22-45a8-96ba-ef376cd75e8a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:48.770245 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e9bc10f6-4f22-45a8-96ba-ef376cd75e8a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1365 microversion: 2.1 time: 0.182035 Jun 23 17:18:48.771067 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 365/747] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:48 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:49.011317 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ba6cdf57-bb88-4fe6-a14f-f61d5964d4f3 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:49.011928 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ba6cdf57-bb88-4fe6-a14f-f61d5964d4f3 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:49.018833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ba6cdf57-bb88-4fe6-a14f-f61d5964d4f3 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:49.019271 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ba6cdf57-bb88-4fe6-a14f-f61d5964d4f3 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:49.020078 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ba6cdf57-bb88-4fe6-a14f-f61d5964d4f3 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:49.020505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ba6cdf57-bb88-4fe6-a14f-f61d5964d4f3 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:49.167788 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ba6cdf57-bb88-4fe6-a14f-f61d5964d4f3 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:49.177343 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ba6cdf57-bb88-4fe6-a14f-f61d5964d4f3 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1577 microversion: 2.1 time: 0.169894 Jun 23 17:18:49.178200 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 383/748] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:49 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:49.220933 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-cca87a21-2b42-46cd-9b29-c884e69dddca req-51da029a-6184-42bf-9808-1d007d995cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eed0594-b0c2-4c93-a04b-898a6e02ca06", "name": "network-vif-unplugged", "status": "completed", "tag": "0ea26bf7-a55b-43ac-9717-c694d5cc21f4"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:49.230686 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-cca87a21-2b42-46cd-9b29-c884e69dddca req-51da029a-6184-42bf-9808-1d007d995cbf service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:49.231292 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-cca87a21-2b42-46cd-9b29-c884e69dddca req-51da029a-6184-42bf-9808-1d007d995cbf service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:49.245913 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-cca87a21-2b42-46cd-9b29-c884e69dddca req-51da029a-6184-42bf-9808-1d007d995cbf service nova] Creating event network-vif-unplugged:0ea26bf7-a55b-43ac-9717-c694d5cc21f4 for instance 4eed0594-b0c2-4c93-a04b-898a6e02ca06 on hv-cinder-83538 Jun 23 17:18:49.251828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-cca87a21-2b42-46cd-9b29-c884e69dddca req-51da029a-6184-42bf-9808-1d007d995cbf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094462 Jun 23 17:18:49.252506 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 366/749] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:18:49.788037 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-48595a80-07f3-418f-8316-6d9d57812a6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:49.788646 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-48595a80-07f3-418f-8316-6d9d57812a6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:49.795101 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-48595a80-07f3-418f-8316-6d9d57812a6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:49.795544 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-48595a80-07f3-418f-8316-6d9d57812a6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:49.796308 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-48595a80-07f3-418f-8316-6d9d57812a6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:49.796733 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-48595a80-07f3-418f-8316-6d9d57812a6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:49.927520 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-48595a80-07f3-418f-8316-6d9d57812a6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:49.935906 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-48595a80-07f3-418f-8316-6d9d57812a6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1365 microversion: 2.1 time: 0.152080 Jun 23 17:18:49.936471 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 384/750] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:49 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:50.199343 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-aa71460d-7ab8-4d11-824c-23d0522e1b34 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:50.200069 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-aa71460d-7ab8-4d11-824c-23d0522e1b34 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:50.209546 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aa71460d-7ab8-4d11-824c-23d0522e1b34 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:50.210094 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aa71460d-7ab8-4d11-824c-23d0522e1b34 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:50.211503 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aa71460d-7ab8-4d11-824c-23d0522e1b34 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:50.212005 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aa71460d-7ab8-4d11-824c-23d0522e1b34 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:50.346748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-aa71460d-7ab8-4d11-824c-23d0522e1b34 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:50.354552 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-aa71460d-7ab8-4d11-824c-23d0522e1b34 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1519 microversion: 2.1 time: 0.161242 Jun 23 17:18:50.355413 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 367/751] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:50 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:50.953040 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c95d789e-e000-4a03-bba4-49f867be4186 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:50.953777 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c95d789e-e000-4a03-bba4-49f867be4186 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:50.956534 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=12 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:50.962210 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c95d789e-e000-4a03-bba4-49f867be4186 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:50.962729 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c95d789e-e000-4a03-bba4-49f867be4186 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:50.963559 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c95d789e-e000-4a03-bba4-49f867be4186 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:50.964315 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c95d789e-e000-4a03-bba4-49f867be4186 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:51.106347 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c95d789e-e000-4a03-bba4-49f867be4186 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:51.115669 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c95d789e-e000-4a03-bba4-49f867be4186 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1365 microversion: 2.1 time: 0.166558 Jun 23 17:18:51.116078 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 385/752] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:50 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:51.266775 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-32fbe71f-2340-4c3b-80c3-32c2b2f83bb5 req-32a7ddf4-c959-44d7-9db8-8d95dcb40402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51605a4b-853e-479f-a3e6-f09880c23d5b", "name": "network-vif-plugged", "status": "completed", "tag": "bd95943b-1970-4801-a4a2-b918b988ab45"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:51.275424 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-32fbe71f-2340-4c3b-80c3-32c2b2f83bb5 req-32a7ddf4-c959-44d7-9db8-8d95dcb40402 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:51.275864 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-32fbe71f-2340-4c3b-80c3-32c2b2f83bb5 req-32a7ddf4-c959-44d7-9db8-8d95dcb40402 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:51.288557 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-32fbe71f-2340-4c3b-80c3-32c2b2f83bb5 req-32a7ddf4-c959-44d7-9db8-8d95dcb40402 service nova] Creating event network-vif-plugged:bd95943b-1970-4801-a4a2-b918b988ab45 for instance 51605a4b-853e-479f-a3e6-f09880c23d5b on hv-cinder-83538 Jun 23 17:18:51.293542 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-32fbe71f-2340-4c3b-80c3-32c2b2f83bb5 req-32a7ddf4-c959-44d7-9db8-8d95dcb40402 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030509 Jun 23 17:18:51.294213 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 368/753] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:18:51.372732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4979cdda-d10b-4be1-ac81-94b3906e6b2f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:51.373537 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4979cdda-d10b-4be1-ac81-94b3906e6b2f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:51.379912 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4979cdda-d10b-4be1-ac81-94b3906e6b2f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:51.380436 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4979cdda-d10b-4be1-ac81-94b3906e6b2f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:51.381260 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4979cdda-d10b-4be1-ac81-94b3906e6b2f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:51.381839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4979cdda-d10b-4be1-ac81-94b3906e6b2f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:51.514126 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4979cdda-d10b-4be1-ac81-94b3906e6b2f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:51.517640 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:51.522071 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4979cdda-d10b-4be1-ac81-94b3906e6b2f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1575 microversion: 2.1 time: 0.153633 Jun 23 17:18:51.522646 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 386/754] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:51 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:52.137435 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0dadcf25-59fb-42c2-af6c-5f001ddb0e95 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:52.138262 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0dadcf25-59fb-42c2-af6c-5f001ddb0e95 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:52.145565 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0dadcf25-59fb-42c2-af6c-5f001ddb0e95 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:52.146099 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0dadcf25-59fb-42c2-af6c-5f001ddb0e95 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:52.146934 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0dadcf25-59fb-42c2-af6c-5f001ddb0e95 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:52.147419 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0dadcf25-59fb-42c2-af6c-5f001ddb0e95 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:52.290333 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0dadcf25-59fb-42c2-af6c-5f001ddb0e95 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:52.298642 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0dadcf25-59fb-42c2-af6c-5f001ddb0e95 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1365 microversion: 2.1 time: 0.168180 Jun 23 17:18:52.299212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 369/755] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:52 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:52.544257 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-cdbc7715-018b-47d8-a65b-967fc221eb1f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:52.545258 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-cdbc7715-018b-47d8-a65b-967fc221eb1f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:52.557129 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cdbc7715-018b-47d8-a65b-967fc221eb1f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:52.557886 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cdbc7715-018b-47d8-a65b-967fc221eb1f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:52.559157 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cdbc7715-018b-47d8-a65b-967fc221eb1f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:52.559604 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cdbc7715-018b-47d8-a65b-967fc221eb1f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:52.704696 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-cdbc7715-018b-47d8-a65b-967fc221eb1f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:52.712608 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-cdbc7715-018b-47d8-a65b-967fc221eb1f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1575 microversion: 2.1 time: 0.175746 Jun 23 17:18:52.713186 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 387/756] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:52 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:53.319103 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-acb7948b-122e-49a6-bbf2-62356ac9d5b7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:53.319955 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-acb7948b-122e-49a6-bbf2-62356ac9d5b7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:53.329769 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-acb7948b-122e-49a6-bbf2-62356ac9d5b7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:53.330442 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-acb7948b-122e-49a6-bbf2-62356ac9d5b7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:53.331508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-acb7948b-122e-49a6-bbf2-62356ac9d5b7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:53.332120 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-acb7948b-122e-49a6-bbf2-62356ac9d5b7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:53.352412 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:53.463821 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-acb7948b-122e-49a6-bbf2-62356ac9d5b7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:53.471600 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-acb7948b-122e-49a6-bbf2-62356ac9d5b7 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1365 microversion: 2.1 time: 0.158082 Jun 23 17:18:53.472172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 370/757] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:53 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:53.731341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-963af3f2-9630-4942-aabc-72561a1d162f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:53.731906 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-963af3f2-9630-4942-aabc-72561a1d162f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:53.738911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-963af3f2-9630-4942-aabc-72561a1d162f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:53.739394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-963af3f2-9630-4942-aabc-72561a1d162f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:53.740143 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-963af3f2-9630-4942-aabc-72561a1d162f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:53.740632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-963af3f2-9630-4942-aabc-72561a1d162f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:53.917550 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-963af3f2-9630-4942-aabc-72561a1d162f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:53.926365 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-963af3f2-9630-4942-aabc-72561a1d162f tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1575 microversion: 2.1 time: 0.199381 Jun 23 17:18:53.926940 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 388/758] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:53 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:54.489108 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2dccda7e-ac5d-4cc9-a038-0b40f559f78c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:54.489698 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2dccda7e-ac5d-4cc9-a038-0b40f559f78c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:54.498202 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2dccda7e-ac5d-4cc9-a038-0b40f559f78c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:54.498945 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2dccda7e-ac5d-4cc9-a038-0b40f559f78c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:54.499707 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2dccda7e-ac5d-4cc9-a038-0b40f559f78c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:54.500136 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2dccda7e-ac5d-4cc9-a038-0b40f559f78c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:54.666403 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2dccda7e-ac5d-4cc9-a038-0b40f559f78c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:54.677183 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2dccda7e-ac5d-4cc9-a038-0b40f559f78c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1365 microversion: 2.1 time: 0.191936 Jun 23 17:18:54.678057 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 371/759] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:54 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:54.948274 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d9615683-eefd-4004-aa3c-ef3544e305df tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:54.948859 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d9615683-eefd-4004-aa3c-ef3544e305df tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:54.956018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d9615683-eefd-4004-aa3c-ef3544e305df tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:54.956465 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d9615683-eefd-4004-aa3c-ef3544e305df tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:54.957225 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d9615683-eefd-4004-aa3c-ef3544e305df tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:54.957652 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d9615683-eefd-4004-aa3c-ef3544e305df tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:55.103993 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d9615683-eefd-4004-aa3c-ef3544e305df tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:55.112100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d9615683-eefd-4004-aa3c-ef3544e305df tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1575 microversion: 2.1 time: 0.167803 Jun 23 17:18:55.112709 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 389/760] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:54 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:55.705036 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3453248b-42e8-46dd-84ab-1cf8aebac180 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:55.705711 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3453248b-42e8-46dd-84ab-1cf8aebac180 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:55.716125 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3453248b-42e8-46dd-84ab-1cf8aebac180 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:55.716571 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3453248b-42e8-46dd-84ab-1cf8aebac180 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:55.717394 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3453248b-42e8-46dd-84ab-1cf8aebac180 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:55.717858 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3453248b-42e8-46dd-84ab-1cf8aebac180 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:55.874697 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3453248b-42e8-46dd-84ab-1cf8aebac180 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:55.882529 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3453248b-42e8-46dd-84ab-1cf8aebac180 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1555 microversion: 2.1 time: 0.184138 Jun 23 17:18:55.883339 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 372/761] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:55 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:55.899986 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-52307fd8-1e71-4e9a-b81b-7b740b73387b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:55.900477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-52307fd8-1e71-4e9a-b81b-7b740b73387b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:55.908665 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-52307fd8-1e71-4e9a-b81b-7b740b73387b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:55.909275 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-52307fd8-1e71-4e9a-b81b-7b740b73387b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:55.910413 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-52307fd8-1e71-4e9a-b81b-7b740b73387b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:55.911003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-52307fd8-1e71-4e9a-b81b-7b740b73387b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:55.997152 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-52307fd8-1e71-4e9a-b81b-7b740b73387b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101025 Jun 23 17:18:55.997871 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 390/762] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 23 17:18:55 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:18:56.129968 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-be4a3438-9280-4394-9e95-6d3e09b0e4fb tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:56.130576 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-be4a3438-9280-4394-9e95-6d3e09b0e4fb tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:56.136845 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-be4a3438-9280-4394-9e95-6d3e09b0e4fb tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:56.137282 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-be4a3438-9280-4394-9e95-6d3e09b0e4fb tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:56.138072 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-be4a3438-9280-4394-9e95-6d3e09b0e4fb tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:56.138504 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-be4a3438-9280-4394-9e95-6d3e09b0e4fb tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:56.406480 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-be4a3438-9280-4394-9e95-6d3e09b0e4fb tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:56.415442 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-be4a3438-9280-4394-9e95-6d3e09b0e4fb tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1575 microversion: 2.1 time: 0.289315 Jun 23 17:18:56.416066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 373/763] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:56 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1575 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:57.283766 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-9ce58182-1fb2-4bea-8b14-b4374a8d67a4 req-a8dccc32-c23d-428e-82d8-721b6e3ae635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51605a4b-853e-479f-a3e6-f09880c23d5b", "tag": "bd95943b-1970-4801-a4a2-b918b988ab45"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:18:57.292390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-9ce58182-1fb2-4bea-8b14-b4374a8d67a4 req-a8dccc32-c23d-428e-82d8-721b6e3ae635 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:57.293041 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-9ce58182-1fb2-4bea-8b14-b4374a8d67a4 req-a8dccc32-c23d-428e-82d8-721b6e3ae635 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:57.304273 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-9ce58182-1fb2-4bea-8b14-b4374a8d67a4 req-a8dccc32-c23d-428e-82d8-721b6e3ae635 service nova] Creating event network-changed:bd95943b-1970-4801-a4a2-b918b988ab45 for instance 51605a4b-853e-479f-a3e6-f09880c23d5b on hv-cinder-83538 Jun 23 17:18:57.309966 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-9ce58182-1fb2-4bea-8b14-b4374a8d67a4 req-a8dccc32-c23d-428e-82d8-721b6e3ae635 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030405 Jun 23 17:18:57.310557 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 391/764] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:18:57.437605 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8e671c1b-f195-4fbf-b36f-66a18857b53e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:57.438257 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8e671c1b-f195-4fbf-b36f-66a18857b53e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:57.445160 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e671c1b-f195-4fbf-b36f-66a18857b53e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:57.445611 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e671c1b-f195-4fbf-b36f-66a18857b53e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:57.446538 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e671c1b-f195-4fbf-b36f-66a18857b53e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:57.447286 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e671c1b-f195-4fbf-b36f-66a18857b53e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:57.647611 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8e671c1b-f195-4fbf-b36f-66a18857b53e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:57.655549 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8e671c1b-f195-4fbf-b36f-66a18857b53e tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1575 microversion: 2.1 time: 0.222737 Jun 23 17:18:57.656019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 374/765] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:57 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:58.678463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b1646da9-3f5f-45ce-8746-a90b1a42ba95 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:58.679951 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b1646da9-3f5f-45ce-8746-a90b1a42ba95 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:58.690393 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b1646da9-3f5f-45ce-8746-a90b1a42ba95 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:58.691048 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b1646da9-3f5f-45ce-8746-a90b1a42ba95 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:58.691899 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b1646da9-3f5f-45ce-8746-a90b1a42ba95 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:58.692441 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b1646da9-3f5f-45ce-8746-a90b1a42ba95 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:58.837605 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b1646da9-3f5f-45ce-8746-a90b1a42ba95 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:18:58.849171 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b1646da9-3f5f-45ce-8746-a90b1a42ba95 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1575 microversion: 2.1 time: 0.178260 Jun 23 17:18:58.849947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 392/766] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:58 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:18:59.871777 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-df27c950-c225-4e04-b0f3-6db0f0af3bd1 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:18:59.872756 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-df27c950-c225-4e04-b0f3-6db0f0af3bd1 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:18:59.876737 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:59.885492 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df27c950-c225-4e04-b0f3-6db0f0af3bd1 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:59.886319 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df27c950-c225-4e04-b0f3-6db0f0af3bd1 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:18:59.887078 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df27c950-c225-4e04-b0f3-6db0f0af3bd1 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:18:59.887504 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df27c950-c225-4e04-b0f3-6db0f0af3bd1 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:00.022849 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-df27c950-c225-4e04-b0f3-6db0f0af3bd1 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:00.032030 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-df27c950-c225-4e04-b0f3-6db0f0af3bd1 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1575 microversion: 2.1 time: 0.167162 Jun 23 17:19:00.032598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 375/767] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:18:59 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:01.049544 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c0e3afce-5db8-4592-b18f-6a16949c8d53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:01.050190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c0e3afce-5db8-4592-b18f-6a16949c8d53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:01.057403 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c0e3afce-5db8-4592-b18f-6a16949c8d53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:01.057985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c0e3afce-5db8-4592-b18f-6a16949c8d53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:01.059185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c0e3afce-5db8-4592-b18f-6a16949c8d53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:01.060004 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c0e3afce-5db8-4592-b18f-6a16949c8d53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:01.195793 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c0e3afce-5db8-4592-b18f-6a16949c8d53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:01.203711 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c0e3afce-5db8-4592-b18f-6a16949c8d53 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1575 microversion: 2.1 time: 0.158109 Jun 23 17:19:01.204307 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 393/768] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:01 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:02.224889 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c11da470-2500-4b6d-8431-80c4c4646394 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:02.225760 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c11da470-2500-4b6d-8431-80c4c4646394 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:02.236898 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c11da470-2500-4b6d-8431-80c4c4646394 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:02.237632 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c11da470-2500-4b6d-8431-80c4c4646394 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:02.238929 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c11da470-2500-4b6d-8431-80c4c4646394 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:02.239647 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c11da470-2500-4b6d-8431-80c4c4646394 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:02.384038 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c11da470-2500-4b6d-8431-80c4c4646394 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:02.391849 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c11da470-2500-4b6d-8431-80c4c4646394 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1575 microversion: 2.1 time: 0.173691 Jun 23 17:19:02.392419 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 376/769] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:02 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:03.126571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-4d97b6fb-f86e-4109-9d44-38dd12f7638b req-3130c78e-a004-4baf-b4e0-006ad3daf58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eed0594-b0c2-4c93-a04b-898a6e02ca06", "name": "network-vif-plugged", "status": "completed", "tag": "0ea26bf7-a55b-43ac-9717-c694d5cc21f4"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:19:03.135821 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-4d97b6fb-f86e-4109-9d44-38dd12f7638b req-3130c78e-a004-4baf-b4e0-006ad3daf58f service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:03.136419 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-4d97b6fb-f86e-4109-9d44-38dd12f7638b req-3130c78e-a004-4baf-b4e0-006ad3daf58f service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:03.162986 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-4d97b6fb-f86e-4109-9d44-38dd12f7638b req-3130c78e-a004-4baf-b4e0-006ad3daf58f service nova] Creating event network-vif-plugged:0ea26bf7-a55b-43ac-9717-c694d5cc21f4 for instance 4eed0594-b0c2-4c93-a04b-898a6e02ca06 on hv-cinder-83538 Jun 23 17:19:03.169458 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-4d97b6fb-f86e-4109-9d44-38dd12f7638b req-3130c78e-a004-4baf-b4e0-006ad3daf58f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046627 Jun 23 17:19:03.170252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 394/770] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:19:03.409030 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bf42e6b3-32bd-43d5-b870-d8411c6733a8 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:03.409603 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bf42e6b3-32bd-43d5-b870-d8411c6733a8 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:03.416644 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bf42e6b3-32bd-43d5-b870-d8411c6733a8 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:03.417092 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bf42e6b3-32bd-43d5-b870-d8411c6733a8 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:03.418128 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bf42e6b3-32bd-43d5-b870-d8411c6733a8 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:03.418546 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bf42e6b3-32bd-43d5-b870-d8411c6733a8 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:03.607534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bf42e6b3-32bd-43d5-b870-d8411c6733a8 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:03.615363 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bf42e6b3-32bd-43d5-b870-d8411c6733a8 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1575 microversion: 2.1 time: 0.210418 Jun 23 17:19:03.615994 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 377/771] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:03 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:04.636818 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f4807bda-f44b-43da-8ab9-ed503c0d8b93 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:04.637941 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f4807bda-f44b-43da-8ab9-ed503c0d8b93 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:04.647246 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f4807bda-f44b-43da-8ab9-ed503c0d8b93 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:04.647799 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f4807bda-f44b-43da-8ab9-ed503c0d8b93 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:04.648742 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f4807bda-f44b-43da-8ab9-ed503c0d8b93 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:04.649285 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f4807bda-f44b-43da-8ab9-ed503c0d8b93 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:04.802226 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f4807bda-f44b-43da-8ab9-ed503c0d8b93 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:04.812444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f4807bda-f44b-43da-8ab9-ed503c0d8b93 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1575 microversion: 2.1 time: 0.181615 Jun 23 17:19:04.813042 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 395/772] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:04 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:05.835330 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8d99e759-a914-47ca-a6fa-c6de6a8c7171 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:05.836494 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8d99e759-a914-47ca-a6fa-c6de6a8c7171 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:05.849371 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8d99e759-a914-47ca-a6fa-c6de6a8c7171 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:05.850280 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8d99e759-a914-47ca-a6fa-c6de6a8c7171 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:05.851834 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8d99e759-a914-47ca-a6fa-c6de6a8c7171 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:05.852564 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8d99e759-a914-47ca-a6fa-c6de6a8c7171 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:05.993598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8d99e759-a914-47ca-a6fa-c6de6a8c7171 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:06.001937 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8d99e759-a914-47ca-a6fa-c6de6a8c7171 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1562 microversion: 2.1 time: 0.173238 Jun 23 17:19:06.002514 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 378/773] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:05 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:06.266547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-20532440-7543-4a18-9a3f-3bf0724de3bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:06.267106 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-20532440-7543-4a18-9a3f-3bf0724de3bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:06.273983 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-20532440-7543-4a18-9a3f-3bf0724de3bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:06.274429 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-20532440-7543-4a18-9a3f-3bf0724de3bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:06.275178 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-20532440-7543-4a18-9a3f-3bf0724de3bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:06.275602 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-20532440-7543-4a18-9a3f-3bf0724de3bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:06.300737 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-20532440-7543-4a18-9a3f-3bf0724de3bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Going to try to terminate instance {{(pid=117897) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:19:06.380780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-20532440-7543-4a18-9a3f-3bf0724de3bc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 204 len: 0 microversion: 2.1 time: 0.117964 Jun 23 17:19:06.381415 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 396/774] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:19:06 2022] DELETE /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:19:06.389950 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-324bbaac-2a2e-47e2-b031-754f2645a9d3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:06.390577 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-324bbaac-2a2e-47e2-b031-754f2645a9d3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:06.396845 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-324bbaac-2a2e-47e2-b031-754f2645a9d3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:06.397293 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-324bbaac-2a2e-47e2-b031-754f2645a9d3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:06.398066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-324bbaac-2a2e-47e2-b031-754f2645a9d3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:06.398502 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-324bbaac-2a2e-47e2-b031-754f2645a9d3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:06.535681 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-324bbaac-2a2e-47e2-b031-754f2645a9d3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:06.543815 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-324bbaac-2a2e-47e2-b031-754f2645a9d3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1578 microversion: 2.1 time: 0.158000 Jun 23 17:19:06.544388 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 379/775] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:06 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:07.565291 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-bffb40ab-2a39-41b3-8886-314ef19851e7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:07.566335 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-bffb40ab-2a39-41b3-8886-314ef19851e7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:07.574808 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bffb40ab-2a39-41b3-8886-314ef19851e7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:07.575359 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bffb40ab-2a39-41b3-8886-314ef19851e7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:07.576339 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bffb40ab-2a39-41b3-8886-314ef19851e7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:07.576828 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bffb40ab-2a39-41b3-8886-314ef19851e7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:07.713772 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-bffb40ab-2a39-41b3-8886-314ef19851e7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:07.723018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-bffb40ab-2a39-41b3-8886-314ef19851e7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1578 microversion: 2.1 time: 0.163500 Jun 23 17:19:07.723630 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 397/776] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:07 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:08.740282 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-122f253b-0bc4-4251-8e75-1a9c6a9bf5c1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:08.740879 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-122f253b-0bc4-4251-8e75-1a9c6a9bf5c1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:08.747745 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-122f253b-0bc4-4251-8e75-1a9c6a9bf5c1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:08.748130 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-122f253b-0bc4-4251-8e75-1a9c6a9bf5c1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:08.748882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-122f253b-0bc4-4251-8e75-1a9c6a9bf5c1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:08.749597 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-122f253b-0bc4-4251-8e75-1a9c6a9bf5c1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:09.045813 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-122f253b-0bc4-4251-8e75-1a9c6a9bf5c1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:09.054304 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-122f253b-0bc4-4251-8e75-1a9c6a9bf5c1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1578 microversion: 2.1 time: 0.317825 Jun 23 17:19:09.054906 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 380/777] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:08 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1578 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:09.795178 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-ce09a239-b55c-4906-afaa-197692e5b9fb req-888db568-c3ce-42b6-a0a0-35c3efa7e7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8f045dd-0ec4-4225-8bae-0035daa2c0ee", "name": "network-vif-deleted", "tag": "5e0d8b7e-7e66-48e6-b53e-f85a41aeb721"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:19:09.804063 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:09.806803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-ce09a239-b55c-4906-afaa-197692e5b9fb req-888db568-c3ce-42b6-a0a0-35c3efa7e7a7 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:09.807252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-ce09a239-b55c-4906-afaa-197692e5b9fb req-888db568-c3ce-42b6-a0a0-35c3efa7e7a7 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:09.820701 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-ce09a239-b55c-4906-afaa-197692e5b9fb req-888db568-c3ce-42b6-a0a0-35c3efa7e7a7 service nova] Creating event network-vif-deleted:5e0d8b7e-7e66-48e6-b53e-f85a41aeb721 for instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee on hv-cinder-83538 Jun 23 17:19:09.826262 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-ce09a239-b55c-4906-afaa-197692e5b9fb req-888db568-c3ce-42b6-a0a0-35c3efa7e7a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040559 Jun 23 17:19:09.827050 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 398/778] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:19:10.072211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9952a541-8d0a-4e70-9974-4412dde9721a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:10.072820 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9952a541-8d0a-4e70-9974-4412dde9721a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:10.079649 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9952a541-8d0a-4e70-9974-4412dde9721a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:10.080120 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9952a541-8d0a-4e70-9974-4412dde9721a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:10.080886 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9952a541-8d0a-4e70-9974-4412dde9721a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:10.081313 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9952a541-8d0a-4e70-9974-4412dde9721a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:10.148865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9952a541-8d0a-4e70-9974-4412dde9721a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:10.157551 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9952a541-8d0a-4e70-9974-4412dde9721a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 200 len: 1226 microversion: 2.1 time: 0.089180 Jun 23 17:19:10.158239 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 381/779] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:10 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:11.181576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e2673655-3953-482a-a65b-a9e2c48b7abc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:11.182696 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e2673655-3953-482a-a65b-a9e2c48b7abc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:11.193362 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e2673655-3953-482a-a65b-a9e2c48b7abc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:11.194162 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e2673655-3953-482a-a65b-a9e2c48b7abc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:11.195394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e2673655-3953-482a-a65b-a9e2c48b7abc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:11.196105 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e2673655-3953-482a-a65b-a9e2c48b7abc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:11.213222 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-e2673655-3953-482a-a65b-a9e2c48b7abc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] HTTP exception thrown: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e2673655-3953-482a-a65b-a9e2c48b7abc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Request method failure captured: Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee HTTP/1.1 Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ-Z7KVHuHnfXlIDzhurTdoORYdnBzHAr5K0ur7EnGyKR6wQYakIQ2uL7npIPAmkACn9VYnkSubroH6VRhjui17QkxWDkJjnAdu83-3gecDXsf0Z6QKwJ5dJ1yd2WCbnd4Ty3dKLOGUxf3VFRz28vh_EMNU8Dd39unN-rIVaoddQb2o Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: e393091e3c2d42e79e9f2ec80d471faf Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-TestVolumeBootPattern-609773018 Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:19:11.214846 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:19:11.216440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e393091e3c2d42e79e9f2ec80d471faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e393091e3c2d42e79e9f2ec80d471faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e393091e3c2d42e79e9f2ec80d471faf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e393091e3c2d42e79e9f2ec80d471faf"}]}] Jun 23 17:19:11.216440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-TestVolumeBootPattern-609773018 Jun 23 17:19:11.216440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: e393091e3c2d42e79e9f2ec80d471faf Jun 23 17:19:11.216440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-TestVolumeBootPattern-609773018 Jun 23 17:19:11.216440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-TestVolumeBootPattern-609773018-project Jun 23 17:19:11.216440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:19:11.216440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:19:11.216440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: d21524f4232648ebaed76e1d7d5daf5f Jun 23 17:19:11.216440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-TestVolumeBootPattern-609773018-project Jun 23 17:19:11.216440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:19:11.216440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:19:11.216440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': 'b8f045dd-0ec4-4225-8bae-0035daa2c0ee'} Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:19:11.217578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:19:11.219242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:11.220602 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e2673655-3953-482a-a65b-a9e2c48b7abc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Returning 404 to user: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:19:11.220602 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e2673655-3953-482a-a65b-a9e2c48b7abc tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 404 len: 111 microversion: 2.1 time: 0.043013 Jun 23 17:19:11.220602 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 399/780] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:11 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:19:11.321777 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-646067434", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1835957938", "security_groups": [{"name": "tempest-secgroup-smoke-1613163096"}], "block_device_mapping_v2": [{"uuid": "0a1f9374-e439-407d-a52b-9a59510f898e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e627980-fd3e-406b-86cf-dac9a328ca6c"}]}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:19:11.444041 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] validate_networks() for [('7e627980-fd3e-406b-86cf-dac9a328ca6c', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:19:11.835044 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:19:11.835686 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:19:11.836326 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:19:11.836971 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:19:11.837426 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:19:11.851112 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:11.851656 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:11.852815 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:11.853449 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:11.871922 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Getting quotas for project e393091e3c2d42e79e9f2ec80d471faf. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:19:11.876225 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Getting quotas for user d21524f4232648ebaed76e1d7d5daf5f and project e393091e3c2d42e79e9f2ec80d471faf. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:19:11.936760 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:19:11.938899 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a1f9374-e439-407d-a52b-9a59510f898e',volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:19:12.083879 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1a7bf372-b4da-409e-9a07-5339ee6dc2af tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.765943 Jun 23 17:19:12.084534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 382/781] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:19:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:19:12.094922 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3d2d01c6-345b-4fff-af6f-f419f488a651 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:12.095635 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3d2d01c6-345b-4fff-af6f-f419f488a651 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:12.149551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3d2d01c6-345b-4fff-af6f-f419f488a651 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:12.156817 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3d2d01c6-345b-4fff-af6f-f419f488a651 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1094 microversion: 2.1 time: 0.065702 Jun 23 17:19:12.157357 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 400/782] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:12 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:13.182726 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a5d0ab99-320b-49a7-b24f-ff66292fdc82 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:13.183329 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a5d0ab99-320b-49a7-b24f-ff66292fdc82 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:13.191716 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5d0ab99-320b-49a7-b24f-ff66292fdc82 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:13.192237 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5d0ab99-320b-49a7-b24f-ff66292fdc82 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:13.193082 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5d0ab99-320b-49a7-b24f-ff66292fdc82 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:13.194871 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5d0ab99-320b-49a7-b24f-ff66292fdc82 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:13.295133 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a5d0ab99-320b-49a7-b24f-ff66292fdc82 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:13.304334 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a5d0ab99-320b-49a7-b24f-ff66292fdc82 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1200 microversion: 2.1 time: 0.131119 Jun 23 17:19:13.305227 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 383/783] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:13 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1200 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:14.330317 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-29fce2b0-13e1-488b-b502-29ff6c0b844b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:14.330925 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-29fce2b0-13e1-488b-b502-29ff6c0b844b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:14.339084 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-29fce2b0-13e1-488b-b502-29ff6c0b844b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:14.340054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-29fce2b0-13e1-488b-b502-29ff6c0b844b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:14.340890 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-29fce2b0-13e1-488b-b502-29ff6c0b844b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:14.341354 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-29fce2b0-13e1-488b-b502-29ff6c0b844b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:14.503075 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-29fce2b0-13e1-488b-b502-29ff6c0b844b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:14.510995 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-29fce2b0-13e1-488b-b502-29ff6c0b844b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1266 microversion: 2.1 time: 0.184800 Jun 23 17:19:14.511658 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 401/784] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:14 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:14.932372 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-fece1bde-2323-49d3-87d4-6db1234cee1b req-dd63b5a5-ba52-495a-9492-595fb2f37720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6202caa7-6072-4d4f-adf6-9e6effa0cae3", "tag": "3da60010-d040-4053-a999-f4b58c9362b0"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:19:14.944768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-fece1bde-2323-49d3-87d4-6db1234cee1b req-dd63b5a5-ba52-495a-9492-595fb2f37720 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:14.945726 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-fece1bde-2323-49d3-87d4-6db1234cee1b req-dd63b5a5-ba52-495a-9492-595fb2f37720 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:14.962013 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-fece1bde-2323-49d3-87d4-6db1234cee1b req-dd63b5a5-ba52-495a-9492-595fb2f37720 service nova] Creating event network-changed:3da60010-d040-4053-a999-f4b58c9362b0 for instance 6202caa7-6072-4d4f-adf6-9e6effa0cae3 on hv-cinder-83538 Jun 23 17:19:14.967274 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-fece1bde-2323-49d3-87d4-6db1234cee1b req-dd63b5a5-ba52-495a-9492-595fb2f37720 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039060 Jun 23 17:19:14.967881 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 384/785] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:19:15.532865 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7cb0dfe1-ccbf-4ad5-a84f-9e8f3d001be3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:15.534095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7cb0dfe1-ccbf-4ad5-a84f-9e8f3d001be3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:15.545119 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7cb0dfe1-ccbf-4ad5-a84f-9e8f3d001be3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:15.545830 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7cb0dfe1-ccbf-4ad5-a84f-9e8f3d001be3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:15.547137 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7cb0dfe1-ccbf-4ad5-a84f-9e8f3d001be3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:15.547844 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7cb0dfe1-ccbf-4ad5-a84f-9e8f3d001be3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:15.697716 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7cb0dfe1-ccbf-4ad5-a84f-9e8f3d001be3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:15.708261 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7cb0dfe1-ccbf-4ad5-a84f-9e8f3d001be3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1266 microversion: 2.1 time: 0.181981 Jun 23 17:19:15.708741 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 402/786] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:15 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:16.725904 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bc07f7c3-5b89-40ad-8633-c63ee93ea22b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:16.726771 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bc07f7c3-5b89-40ad-8633-c63ee93ea22b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:16.734436 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bc07f7c3-5b89-40ad-8633-c63ee93ea22b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:16.734920 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bc07f7c3-5b89-40ad-8633-c63ee93ea22b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:16.735931 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bc07f7c3-5b89-40ad-8633-c63ee93ea22b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:16.736535 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bc07f7c3-5b89-40ad-8633-c63ee93ea22b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:16.944587 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bc07f7c3-5b89-40ad-8633-c63ee93ea22b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:16.952576 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bc07f7c3-5b89-40ad-8633-c63ee93ea22b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1266 microversion: 2.1 time: 0.231025 Jun 23 17:19:16.953202 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 385/787] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:16 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:17.972239 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-dc53af54-add2-4b20-871b-465c22f77172 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:17.973006 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-dc53af54-add2-4b20-871b-465c22f77172 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:17.982224 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-dc53af54-add2-4b20-871b-465c22f77172 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:17.982822 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-dc53af54-add2-4b20-871b-465c22f77172 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:17.983831 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-dc53af54-add2-4b20-871b-465c22f77172 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:17.984405 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-dc53af54-add2-4b20-871b-465c22f77172 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:18.118820 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-dc53af54-add2-4b20-871b-465c22f77172 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:18.126641 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-dc53af54-add2-4b20-871b-465c22f77172 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1266 microversion: 2.1 time: 0.159918 Jun 23 17:19:18.127335 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 403/788] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:17 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:19.147880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-89b47520-7090-4871-bc58-fdcc24f1815a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:19.148739 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-89b47520-7090-4871-bc58-fdcc24f1815a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:19.155395 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89b47520-7090-4871-bc58-fdcc24f1815a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:19.155832 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89b47520-7090-4871-bc58-fdcc24f1815a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:19.156590 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89b47520-7090-4871-bc58-fdcc24f1815a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:19.156998 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89b47520-7090-4871-bc58-fdcc24f1815a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:19.293640 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-89b47520-7090-4871-bc58-fdcc24f1815a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:19.301829 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-89b47520-7090-4871-bc58-fdcc24f1815a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1266 microversion: 2.1 time: 0.158231 Jun 23 17:19:19.302401 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 386/789] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:19 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:20.323098 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-bee3b8ef-9f91-4b76-865a-930aa52525f8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:20.324076 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-bee3b8ef-9f91-4b76-865a-930aa52525f8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:20.333288 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bee3b8ef-9f91-4b76-865a-930aa52525f8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:20.333729 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bee3b8ef-9f91-4b76-865a-930aa52525f8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:20.334514 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bee3b8ef-9f91-4b76-865a-930aa52525f8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:20.334943 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bee3b8ef-9f91-4b76-865a-930aa52525f8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:20.486933 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-bee3b8ef-9f91-4b76-865a-930aa52525f8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:20.494860 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-bee3b8ef-9f91-4b76-865a-930aa52525f8 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1266 microversion: 2.1 time: 0.178225 Jun 23 17:19:20.495431 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 404/790] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:20 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:21.515866 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1910a0fa-d525-4aa1-a9ca-d66bf7c4f663 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:21.516917 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1910a0fa-d525-4aa1-a9ca-d66bf7c4f663 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:21.524467 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1910a0fa-d525-4aa1-a9ca-d66bf7c4f663 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:21.524920 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1910a0fa-d525-4aa1-a9ca-d66bf7c4f663 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:21.525675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1910a0fa-d525-4aa1-a9ca-d66bf7c4f663 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:21.526142 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1910a0fa-d525-4aa1-a9ca-d66bf7c4f663 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:21.671912 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1910a0fa-d525-4aa1-a9ca-d66bf7c4f663 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:21.680976 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1910a0fa-d525-4aa1-a9ca-d66bf7c4f663 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1266 microversion: 2.1 time: 0.171695 Jun 23 17:19:21.681516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 387/791] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:21 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:22.699535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-68a9b92b-b135-44be-a2ca-44e7254fb368 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:22.700293 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-68a9b92b-b135-44be-a2ca-44e7254fb368 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:22.703385 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=2 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:22.710239 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-68a9b92b-b135-44be-a2ca-44e7254fb368 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:22.710790 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-68a9b92b-b135-44be-a2ca-44e7254fb368 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:22.711722 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-68a9b92b-b135-44be-a2ca-44e7254fb368 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:22.712253 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-68a9b92b-b135-44be-a2ca-44e7254fb368 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:22.715661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:22.860619 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-68a9b92b-b135-44be-a2ca-44e7254fb368 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:22.868488 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-68a9b92b-b135-44be-a2ca-44e7254fb368 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1266 microversion: 2.1 time: 0.173745 Jun 23 17:19:22.869089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 405/792] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:22 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:23.888916 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c371058e-5796-4d19-9cd2-688a85e1b580 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:23.890007 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c371058e-5796-4d19-9cd2-688a85e1b580 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:23.892854 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:23.893504 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:23.900339 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c371058e-5796-4d19-9cd2-688a85e1b580 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:23.900780 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c371058e-5796-4d19-9cd2-688a85e1b580 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:23.901541 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c371058e-5796-4d19-9cd2-688a85e1b580 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:23.902014 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c371058e-5796-4d19-9cd2-688a85e1b580 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:23.904737 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=97 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:24.043744 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c371058e-5796-4d19-9cd2-688a85e1b580 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:24.051723 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c371058e-5796-4d19-9cd2-688a85e1b580 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1266 microversion: 2.1 time: 0.169469 Jun 23 17:19:24.052294 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 388/793] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:23 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:25.074763 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6bec4a33-2a0b-4299-8f64-50778dc94bc2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:25.075715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6bec4a33-2a0b-4299-8f64-50778dc94bc2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:25.087113 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6bec4a33-2a0b-4299-8f64-50778dc94bc2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:25.087866 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6bec4a33-2a0b-4299-8f64-50778dc94bc2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:25.089260 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6bec4a33-2a0b-4299-8f64-50778dc94bc2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:25.090145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6bec4a33-2a0b-4299-8f64-50778dc94bc2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:25.232210 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6bec4a33-2a0b-4299-8f64-50778dc94bc2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:25.240070 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6bec4a33-2a0b-4299-8f64-50778dc94bc2 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1266 microversion: 2.1 time: 0.171881 Jun 23 17:19:25.249079 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 406/794] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:25 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:26.261188 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d46d5fcc-5004-4e1e-95d9-12e253dfbfd4 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:26.262343 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d46d5fcc-5004-4e1e-95d9-12e253dfbfd4 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:26.271623 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d46d5fcc-5004-4e1e-95d9-12e253dfbfd4 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:26.272063 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d46d5fcc-5004-4e1e-95d9-12e253dfbfd4 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:26.272846 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d46d5fcc-5004-4e1e-95d9-12e253dfbfd4 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:26.273271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d46d5fcc-5004-4e1e-95d9-12e253dfbfd4 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:26.407956 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d46d5fcc-5004-4e1e-95d9-12e253dfbfd4 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:26.416023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d46d5fcc-5004-4e1e-95d9-12e253dfbfd4 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1266 microversion: 2.1 time: 0.161344 Jun 23 17:19:26.416559 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 389/795] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:26 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:27.284359 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-5b137134-ce06-4c0f-b3e0-6a7ae22cae09 req-f69c3081-1bce-46f3-8cc3-a6acfa76d069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6202caa7-6072-4d4f-adf6-9e6effa0cae3", "name": "network-vif-plugged", "status": "completed", "tag": "3da60010-d040-4053-a999-f4b58c9362b0"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:19:27.293283 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-5b137134-ce06-4c0f-b3e0-6a7ae22cae09 req-f69c3081-1bce-46f3-8cc3-a6acfa76d069 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:27.293756 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-5b137134-ce06-4c0f-b3e0-6a7ae22cae09 req-f69c3081-1bce-46f3-8cc3-a6acfa76d069 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:27.306072 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-5b137134-ce06-4c0f-b3e0-6a7ae22cae09 req-f69c3081-1bce-46f3-8cc3-a6acfa76d069 service nova] Creating event network-vif-plugged:3da60010-d040-4053-a999-f4b58c9362b0 for instance 6202caa7-6072-4d4f-adf6-9e6effa0cae3 on hv-cinder-83538 Jun 23 17:19:27.311094 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-5b137134-ce06-4c0f-b3e0-6a7ae22cae09 req-f69c3081-1bce-46f3-8cc3-a6acfa76d069 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030813 Jun 23 17:19:27.311701 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 407/796] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:19:27.433158 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d1866d00-1230-474d-8b5b-82ab76cf4f61 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:27.433764 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d1866d00-1230-474d-8b5b-82ab76cf4f61 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:27.440866 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d1866d00-1230-474d-8b5b-82ab76cf4f61 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:27.441317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d1866d00-1230-474d-8b5b-82ab76cf4f61 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:27.442114 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d1866d00-1230-474d-8b5b-82ab76cf4f61 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:27.442548 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d1866d00-1230-474d-8b5b-82ab76cf4f61 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:27.586404 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d1866d00-1230-474d-8b5b-82ab76cf4f61 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:27.594300 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d1866d00-1230-474d-8b5b-82ab76cf4f61 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1266 microversion: 2.1 time: 0.165349 Jun 23 17:19:27.594882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 390/797] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:27 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:28.600800 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a4ce2907-b18a-44b6-82e9-a1745b8027f5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-585408897"}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:19:28.601421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a4ce2907-b18a-44b6-82e9-a1745b8027f5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:28.607842 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a4ce2907-b18a-44b6-82e9-a1745b8027f5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:28.608285 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a4ce2907-b18a-44b6-82e9-a1745b8027f5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:28.609030 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a4ce2907-b18a-44b6-82e9-a1745b8027f5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:28.609455 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a4ce2907-b18a-44b6-82e9-a1745b8027f5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:28.611303 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b8a8c5db-43ea-4035-ba01-0879e83697ea tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:28.611915 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b8a8c5db-43ea-4035-ba01-0879e83697ea tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:28.619193 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b8a8c5db-43ea-4035-ba01-0879e83697ea tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:28.619639 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b8a8c5db-43ea-4035-ba01-0879e83697ea tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:28.620401 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b8a8c5db-43ea-4035-ba01-0879e83697ea tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:28.620831 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b8a8c5db-43ea-4035-ba01-0879e83697ea tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:28.741012 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.network.security_group_api [None req-a4ce2907-b18a-44b6-82e9-a1745b8027f5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Removing security group cb78783d-ec84-4997-acd0-f10a4bde3494 from port f326af8b-43a2-44c9-902a-68353086ffbf Jun 23 17:19:28.758512 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b8a8c5db-43ea-4035-ba01-0879e83697ea tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:28.766094 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b8a8c5db-43ea-4035-ba01-0879e83697ea tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1266 microversion: 2.1 time: 0.158699 Jun 23 17:19:28.766662 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 391/798] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:28 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:29.330554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a4ce2907-b18a-44b6-82e9-a1745b8027f5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "POST /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/action" status: 202 len: 0 microversion: 2.1 time: 0.735702 Jun 23 17:19:29.334536 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 408/799] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 23 17:19:28 2022] POST /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/action => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:19:29.340637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-13f70bf5-b7be-471e-872a-1926b0371364 req-aa518309-3407-4bad-9c99-ba793c97eb38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80236cf3-b3a0-42de-89ee-da5deb3de2a1", "tag": "f326af8b-43a2-44c9-902a-68353086ffbf"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:19:29.349301 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-13f70bf5-b7be-471e-872a-1926b0371364 req-aa518309-3407-4bad-9c99-ba793c97eb38 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:29.350027 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-13f70bf5-b7be-471e-872a-1926b0371364 req-aa518309-3407-4bad-9c99-ba793c97eb38 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:29.362812 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-13f70bf5-b7be-471e-872a-1926b0371364 req-aa518309-3407-4bad-9c99-ba793c97eb38 service nova] Creating event network-changed:f326af8b-43a2-44c9-902a-68353086ffbf for instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 on hv-cinder-83538 Jun 23 17:19:29.376163 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-13f70bf5-b7be-471e-872a-1926b0371364 req-aa518309-3407-4bad-9c99-ba793c97eb38 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033136 Jun 23 17:19:29.377227 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 392/800] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:19:29.786756 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5295d5bb-3972-4dd7-834f-0212a3027171 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:29.787340 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5295d5bb-3972-4dd7-834f-0212a3027171 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:29.794030 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5295d5bb-3972-4dd7-834f-0212a3027171 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:29.794473 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5295d5bb-3972-4dd7-834f-0212a3027171 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:29.795519 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5295d5bb-3972-4dd7-834f-0212a3027171 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:29.795924 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5295d5bb-3972-4dd7-834f-0212a3027171 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:29.984809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5295d5bb-3972-4dd7-834f-0212a3027171 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:29.992973 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5295d5bb-3972-4dd7-834f-0212a3027171 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1453 microversion: 2.1 time: 0.213524 Jun 23 17:19:30.000644 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 409/801] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:29 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1453 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:30.010337 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9a0e4094-d89c-4ae5-93d4-c13c541ecf33 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:30.011101 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9a0e4094-d89c-4ae5-93d4-c13c541ecf33 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:30.016471 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:30.018804 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a0e4094-d89c-4ae5-93d4-c13c541ecf33 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:30.019380 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a0e4094-d89c-4ae5-93d4-c13c541ecf33 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:30.020338 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a0e4094-d89c-4ae5-93d4-c13c541ecf33 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:30.020890 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a0e4094-d89c-4ae5-93d4-c13c541ecf33 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:30.212052 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9a0e4094-d89c-4ae5-93d4-c13c541ecf33 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:30.220046 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9a0e4094-d89c-4ae5-93d4-c13c541ecf33 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1453 microversion: 2.1 time: 0.214319 Jun 23 17:19:30.220606 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 393/802] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:30 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1453 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:30.688784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3a84f691-e1e0-4f8c-a2fe-b536834ed61b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:30.688925 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3a84f691-e1e0-4f8c-a2fe-b536834ed61b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:30.696288 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a84f691-e1e0-4f8c-a2fe-b536834ed61b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:30.696722 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a84f691-e1e0-4f8c-a2fe-b536834ed61b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:30.697537 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a84f691-e1e0-4f8c-a2fe-b536834ed61b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:30.697998 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a84f691-e1e0-4f8c-a2fe-b536834ed61b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:30.789565 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-3a84f691-e1e0-4f8c-a2fe-b536834ed61b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lazy-loading 'services' on Instance uuid 80236cf3-b3a0-42de-89ee-da5deb3de2a1 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:19:30.873110 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3a84f691-e1e0-4f8c-a2fe-b536834ed61b tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "DELETE /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/os-volume_attachments/c9fc3aa1-0b2b-4997-8af1-4cf72408205c" status: 202 len: 0 microversion: 2.1 time: 0.188904 Jun 23 17:19:30.888934 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-dc42ec2e-6308-46db-a094-9b91474509f0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:30.890829 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-dc42ec2e-6308-46db-a094-9b91474509f0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:30.897080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 410/803] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 23 17:19:30 2022] DELETE /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/os-volume_attachments/c9fc3aa1-0b2b-4997-8af1-4cf72408205c => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:19:30.905169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dc42ec2e-6308-46db-a094-9b91474509f0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:30.905608 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dc42ec2e-6308-46db-a094-9b91474509f0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:30.906431 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dc42ec2e-6308-46db-a094-9b91474509f0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:30.907033 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dc42ec2e-6308-46db-a094-9b91474509f0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:30.961276 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-dc42ec2e-6308-46db-a094-9b91474509f0 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082445 Jun 23 17:19:30.967006 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 394/804] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:19:30 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:19:31.400560 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-e07c743a-eee3-464b-b721-f1d560f5a4b5 req-516ea1e6-77d9-4001-942e-8a2cc202b15a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80236cf3-b3a0-42de-89ee-da5deb3de2a1", "tag": "f326af8b-43a2-44c9-902a-68353086ffbf"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:19:31.409338 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-e07c743a-eee3-464b-b721-f1d560f5a4b5 req-516ea1e6-77d9-4001-942e-8a2cc202b15a service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:31.409982 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-e07c743a-eee3-464b-b721-f1d560f5a4b5 req-516ea1e6-77d9-4001-942e-8a2cc202b15a service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:31.421994 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-e07c743a-eee3-464b-b721-f1d560f5a4b5 req-516ea1e6-77d9-4001-942e-8a2cc202b15a service nova] Creating event network-changed:f326af8b-43a2-44c9-902a-68353086ffbf for instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 on hv-cinder-83538 Jun 23 17:19:31.427319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-e07c743a-eee3-464b-b721-f1d560f5a4b5 req-516ea1e6-77d9-4001-942e-8a2cc202b15a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031045 Jun 23 17:19:31.427917 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 411/805] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:19:31.974956 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e650f125-c6b9-4f0f-8d02-8d8588508d87 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:31.975966 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e650f125-c6b9-4f0f-8d02-8d8588508d87 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:31.984386 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e650f125-c6b9-4f0f-8d02-8d8588508d87 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:31.985097 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e650f125-c6b9-4f0f-8d02-8d8588508d87 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:31.986095 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e650f125-c6b9-4f0f-8d02-8d8588508d87 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:31.986704 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e650f125-c6b9-4f0f-8d02-8d8588508d87 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:32.019162 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e650f125-c6b9-4f0f-8d02-8d8588508d87 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048728 Jun 23 17:19:32.020444 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 395/806] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:19:31 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:19:33.037134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d9bb1dd0-03cb-439f-a5e5-9434f835f33e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:33.038332 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d9bb1dd0-03cb-439f-a5e5-9434f835f33e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:33.045136 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d9bb1dd0-03cb-439f-a5e5-9434f835f33e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:33.045576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d9bb1dd0-03cb-439f-a5e5-9434f835f33e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:33.046407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d9bb1dd0-03cb-439f-a5e5-9434f835f33e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:33.046835 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d9bb1dd0-03cb-439f-a5e5-9434f835f33e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:33.076863 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d9bb1dd0-03cb-439f-a5e5-9434f835f33e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049114 Jun 23 17:19:33.077449 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 412/807] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:19:33 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 17:19:33.088060 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7134c76d-f297-4371-8da5-028e84206a6a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:33.088668 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7134c76d-f297-4371-8da5-028e84206a6a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:33.096040 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7134c76d-f297-4371-8da5-028e84206a6a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:33.096613 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7134c76d-f297-4371-8da5-028e84206a6a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:33.098116 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7134c76d-f297-4371-8da5-028e84206a6a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:33.098662 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7134c76d-f297-4371-8da5-028e84206a6a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:33.183517 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-7134c76d-f297-4371-8da5-028e84206a6a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] HTTP exception thrown: Instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 is not attached to volume c9fc3aa1-0b2b-4997-8af1-4cf72408205c Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7134c76d-f297-4371-8da5-028e84206a6a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Request method failure captured: Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: DELETE /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/os-volume_attachments/c9fc3aa1-0b2b-4997-8af1-4cf72408205c HTTP/1.1 Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ-zWssXw38dsbGWDCBjnIrD9cAXdiyeEZNEtcQ8GHUsPx9K57pFatxOuvQuUB3cUo3VOY7TseelzoKVE-_VxoeJACr_fyAs-HkKAcBuMhwP-BqDH6ZbZzAK3ZLowi24eE6-R4LikR2XlnpG9psKA6lc1MQpLB5ffq425KRkQU5l4I8 Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: 26dde39423224c57b71005a60dacbed3 Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-TestMinimumBasicScenario-342313734 Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:19:33.186159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:19:33.187826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/26dde39423224c57b71005a60dacbed3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/26dde39423224c57b71005a60dacbed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_26dde39423224c57b71005a60dacbed3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/26dde39423224c57b71005a60dacbed3"}]}] Jun 23 17:19:33.187826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-TestMinimumBasicScenario-342313734 Jun 23 17:19:33.187826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 26dde39423224c57b71005a60dacbed3 Jun 23 17:19:33.187826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-TestMinimumBasicScenario-342313734 Jun 23 17:19:33.187826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-TestMinimumBasicScenario-342313734-project Jun 23 17:19:33.187826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:19:33.187826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:19:33.187826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: fc83928b1a17490086c5698735ed5646 Jun 23 17:19:33.187826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-TestMinimumBasicScenario-342313734-project Jun 23 17:19:33.187826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:19:33.187826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 is not attached to volume c9fc3aa1-0b2b-4997-8af1-4cf72408205c Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'server_id': '80236cf3-b3a0-42de-89ee-da5deb3de2a1', 'id': 'c9fc3aa1-0b2b-4997-8af1-4cf72408205c'} Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c9fc3aa1-0b2b-4997-8af1-4cf72408205c. Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:19:33.188634 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 is not attached to volume c9fc3aa1-0b2b-4997-8af1-4cf72408205c Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 is not attached to volume c9fc3aa1-0b2b-4997-8af1-4cf72408205c Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:33.189843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7134c76d-f297-4371-8da5-028e84206a6a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Returning 404 to user: Instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 is not attached to volume c9fc3aa1-0b2b-4997-8af1-4cf72408205c {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:19:33.190970 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7134c76d-f297-4371-8da5-028e84206a6a tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "DELETE /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/os-volume_attachments/c9fc3aa1-0b2b-4997-8af1-4cf72408205c" status: 404 len: 154 microversion: 2.1 time: 0.103855 Jun 23 17:19:33.190970 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 396/808] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 23 17:19:33 2022] DELETE /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1/os-volume_attachments/c9fc3aa1-0b2b-4997-8af1-4cf72408205c => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:19:33.446747 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-a3e0eb1c-43d9-4ae8-a78e-e71b16657ec7 req-77eeb387-e611-43ef-a9f7-1ef1585534d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6202caa7-6072-4d4f-adf6-9e6effa0cae3", "tag": "3da60010-d040-4053-a999-f4b58c9362b0"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:19:33.457329 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-a3e0eb1c-43d9-4ae8-a78e-e71b16657ec7 req-77eeb387-e611-43ef-a9f7-1ef1585534d9 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:33.457818 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-a3e0eb1c-43d9-4ae8-a78e-e71b16657ec7 req-77eeb387-e611-43ef-a9f7-1ef1585534d9 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:33.469511 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-a3e0eb1c-43d9-4ae8-a78e-e71b16657ec7 req-77eeb387-e611-43ef-a9f7-1ef1585534d9 service nova] Creating event network-changed:3da60010-d040-4053-a999-f4b58c9362b0 for instance 6202caa7-6072-4d4f-adf6-9e6effa0cae3 on hv-cinder-83538 Jun 23 17:19:33.475406 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-a3e0eb1c-43d9-4ae8-a78e-e71b16657ec7 req-77eeb387-e611-43ef-a9f7-1ef1585534d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033676 Jun 23 17:19:33.476148 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 413/809] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:19:34.344993 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-37af14b5-8136-49bd-bc8b-1be096c2d9e3 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:34.345512 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-37af14b5-8136-49bd-bc8b-1be096c2d9e3 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:34.352619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37af14b5-8136-49bd-bc8b-1be096c2d9e3 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:34.353065 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37af14b5-8136-49bd-bc8b-1be096c2d9e3 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:34.353833 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37af14b5-8136-49bd-bc8b-1be096c2d9e3 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:34.354281 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37af14b5-8136-49bd-bc8b-1be096c2d9e3 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:34.379320 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-37af14b5-8136-49bd-bc8b-1be096c2d9e3 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:19:34.466874 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-37af14b5-8136-49bd-bc8b-1be096c2d9e3 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "DELETE /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 204 len: 0 microversion: 2.1 time: 0.125683 Jun 23 17:19:34.467873 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 397/810] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:19:34 2022] DELETE /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:19:34.478279 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-cb8792dd-491f-488f-9fc0-eaab8346e9be tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:34.478971 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-cb8792dd-491f-488f-9fc0-eaab8346e9be tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:34.486200 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cb8792dd-491f-488f-9fc0-eaab8346e9be tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:34.486644 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cb8792dd-491f-488f-9fc0-eaab8346e9be tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:34.487437 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cb8792dd-491f-488f-9fc0-eaab8346e9be tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:34.487873 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cb8792dd-491f-488f-9fc0-eaab8346e9be tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:34.632215 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-cb8792dd-491f-488f-9fc0-eaab8346e9be tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:34.639931 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-cb8792dd-491f-488f-9fc0-eaab8346e9be tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1554 microversion: 2.1 time: 0.166097 Jun 23 17:19:34.640507 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 414/811] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:34 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:35.662218 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d317e768-e391-4ef9-be6a-8cc23ce8bcc5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:35.663015 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d317e768-e391-4ef9-be6a-8cc23ce8bcc5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:35.674467 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d317e768-e391-4ef9-be6a-8cc23ce8bcc5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:35.675062 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d317e768-e391-4ef9-be6a-8cc23ce8bcc5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:35.675819 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d317e768-e391-4ef9-be6a-8cc23ce8bcc5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:35.676390 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d317e768-e391-4ef9-be6a-8cc23ce8bcc5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:35.816264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d317e768-e391-4ef9-be6a-8cc23ce8bcc5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:35.823971 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d317e768-e391-4ef9-be6a-8cc23ce8bcc5 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1554 microversion: 2.1 time: 0.168880 Jun 23 17:19:35.824543 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 398/812] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:35 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:36.846366 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b6fb5d55-693e-4d16-b998-936c191067ef tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:36.847119 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b6fb5d55-693e-4d16-b998-936c191067ef tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:36.854317 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b6fb5d55-693e-4d16-b998-936c191067ef tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:36.854770 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b6fb5d55-693e-4d16-b998-936c191067ef tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:36.855526 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b6fb5d55-693e-4d16-b998-936c191067ef tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:36.855956 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b6fb5d55-693e-4d16-b998-936c191067ef tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:36.983590 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b6fb5d55-693e-4d16-b998-936c191067ef tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc83928b1a17490086c5698735ed5646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26dde39423224c57b71005a60dacbed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:36.991744 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b6fb5d55-693e-4d16-b998-936c191067ef tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 200 len: 1554 microversion: 2.1 time: 0.151423 Jun 23 17:19:36.992302 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 415/813] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:36 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:37.288473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-74e0490a-ebd2-46a6-9595-0eac735dbd26 req-adbd488e-c960-47ba-a73b-c1ec281781d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80236cf3-b3a0-42de-89ee-da5deb3de2a1", "name": "network-vif-deleted", "tag": "f326af8b-43a2-44c9-902a-68353086ffbf"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:19:37.297506 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-74e0490a-ebd2-46a6-9595-0eac735dbd26 req-adbd488e-c960-47ba-a73b-c1ec281781d4 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:37.297983 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-74e0490a-ebd2-46a6-9595-0eac735dbd26 req-adbd488e-c960-47ba-a73b-c1ec281781d4 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:37.309602 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-74e0490a-ebd2-46a6-9595-0eac735dbd26 req-adbd488e-c960-47ba-a73b-c1ec281781d4 service nova] Creating event network-vif-deleted:f326af8b-43a2-44c9-902a-68353086ffbf for instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 on hv-cinder-83538 Jun 23 17:19:37.314391 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-74e0490a-ebd2-46a6-9595-0eac735dbd26 req-adbd488e-c960-47ba-a73b-c1ec281781d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029752 Jun 23 17:19:37.315055 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 399/814] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:19:38.003463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9d4d70ff-c8ed-4579-abdd-8a6a026a67d8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:38.004124 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9d4d70ff-c8ed-4579-abdd-8a6a026a67d8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:38.009107 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5cc64dd1-8f11-4116-9848-b0e8c222724e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:38.009821 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5cc64dd1-8f11-4116-9848-b0e8c222724e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] [instance: 80236cf3-b3a0-42de-89ee-da5deb3de2a1] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:38.010877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9d4d70ff-c8ed-4579-abdd-8a6a026a67d8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:38.011470 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9d4d70ff-c8ed-4579-abdd-8a6a026a67d8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:38.012071 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9d4d70ff-c8ed-4579-abdd-8a6a026a67d8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:38.012780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9d4d70ff-c8ed-4579-abdd-8a6a026a67d8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:38.016391 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5cc64dd1-8f11-4116-9848-b0e8c222724e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:38.016775 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5cc64dd1-8f11-4116-9848-b0e8c222724e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:38.017543 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5cc64dd1-8f11-4116-9848-b0e8c222724e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:38.018025 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5cc64dd1-8f11-4116-9848-b0e8c222724e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:38.032131 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-5cc64dd1-8f11-4116-9848-b0e8c222724e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] HTTP exception thrown: Instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 could not be found. Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5cc64dd1-8f11-4116-9848-b0e8c222724e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Request method failure captured: Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 HTTP/1.1 Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ-zWssXw38dsbGWDCBjnIrD9cAXdiyeEZNEtcQ8GHUsPx9K57pFatxOuvQuUB3cUo3VOY7TseelzoKVE-_VxoeJACr_fyAs-HkKAcBuMhwP-BqDH6ZbZzAK3ZLowi24eE6-R4LikR2XlnpG9psKA6lc1MQpLB5ffq425KRkQU5l4I8 Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: 26dde39423224c57b71005a60dacbed3 Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-TestMinimumBasicScenario-342313734 Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:19:38.033763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:19:38.037080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/26dde39423224c57b71005a60dacbed3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/26dde39423224c57b71005a60dacbed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_26dde39423224c57b71005a60dacbed3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/26dde39423224c57b71005a60dacbed3"}]}] Jun 23 17:19:38.037080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-TestMinimumBasicScenario-342313734 Jun 23 17:19:38.037080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 26dde39423224c57b71005a60dacbed3 Jun 23 17:19:38.037080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-TestMinimumBasicScenario-342313734 Jun 23 17:19:38.037080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-TestMinimumBasicScenario-342313734-project Jun 23 17:19:38.037080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:19:38.037080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:19:38.037080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: fc83928b1a17490086c5698735ed5646 Jun 23 17:19:38.037080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-TestMinimumBasicScenario-342313734-project Jun 23 17:19:38.037080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:19:38.037080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 could not be found. Jun 23 17:19:38.037080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '80236cf3-b3a0-42de-89ee-da5deb3de2a1'} Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 could not be found. Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:19:38.038023 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 could not be found. Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 could not be found. Jun 23 17:19:38.039508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:38.040808 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5cc64dd1-8f11-4116-9848-b0e8c222724e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Returning 404 to user: Instance 80236cf3-b3a0-42de-89ee-da5deb3de2a1 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:19:38.040808 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5cc64dd1-8f11-4116-9848-b0e8c222724e tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1" status: 404 len: 111 microversion: 2.1 time: 0.030449 Jun 23 17:19:38.040808 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 400/815] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:38 2022] GET /compute/v2.1/servers/80236cf3-b3a0-42de-89ee-da5deb3de2a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:19:38.043713 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3874c74e-a577-4791-97c0-0dc51f096a11 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] Calling method '.version_select at 0x7f34323d24c0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:38.064543 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3874c74e-a577-4791-97c0-0dc51f096a11 tempest-TestMinimumBasicScenario-342313734 tempest-TestMinimumBasicScenario-342313734-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1352412883" status: 202 len: 0 microversion: 2.1 time: 0.024298 Jun 23 17:19:38.065212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 401/816] 10.222.0.18 () {58 vars in 1271 bytes} [Thu Jun 23 17:19:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1352412883 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:19:38.099623 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-9d4d70ff-c8ed-4579-abdd-8a6a026a67d8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lazy-loading 'services' on Instance uuid 410f9789-fe14-436c-b928-5e32f1057008 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:19:38.177635 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9d4d70ff-c8ed-4579-abdd-8a6a026a67d8 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "DELETE /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-volume_attachments/cec0368b-5e40-4664-b93e-aa42cbb91c35" status: 202 len: 0 microversion: 2.1 time: 0.177883 Jun 23 17:19:38.179123 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 416/817] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 23 17:19:37 2022] DELETE /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-volume_attachments/cec0368b-5e40-4664-b93e-aa42cbb91c35 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:19:38.192081 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-68f871e4-a600-463d-b898-4b498c8ddd14 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:38.199450 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-68f871e4-a600-463d-b898-4b498c8ddd14 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:38.212989 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68f871e4-a600-463d-b898-4b498c8ddd14 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:38.213536 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68f871e4-a600-463d-b898-4b498c8ddd14 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:38.214839 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68f871e4-a600-463d-b898-4b498c8ddd14 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:38.215278 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68f871e4-a600-463d-b898-4b498c8ddd14 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:38.257050 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-68f871e4-a600-463d-b898-4b498c8ddd14 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072091 Jun 23 17:19:38.257436 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 402/818] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:19:38 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:19:39.269340 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-997e52b1-4ee4-464c-b3c9-f3bf76fe4cd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:39.271073 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-997e52b1-4ee4-464c-b3c9-f3bf76fe4cd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:39.277609 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-997e52b1-4ee4-464c-b3c9-f3bf76fe4cd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:39.278080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-997e52b1-4ee4-464c-b3c9-f3bf76fe4cd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:39.278836 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-997e52b1-4ee4-464c-b3c9-f3bf76fe4cd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:39.279265 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-997e52b1-4ee4-464c-b3c9-f3bf76fe4cd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:39.309192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-997e52b1-4ee4-464c-b3c9-f3bf76fe4cd7 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044227 Jun 23 17:19:39.309755 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 417/819] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:19:39 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 17:19:39.378814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e9e98457-fcb0-4429-ae7e-6b879ff69058 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:39.379408 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e9e98457-fcb0-4429-ae7e-6b879ff69058 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:39.386074 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9e98457-fcb0-4429-ae7e-6b879ff69058 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:39.386515 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9e98457-fcb0-4429-ae7e-6b879ff69058 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:39.387272 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9e98457-fcb0-4429-ae7e-6b879ff69058 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:39.387694 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9e98457-fcb0-4429-ae7e-6b879ff69058 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:39.412589 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e9e98457-fcb0-4429-ae7e-6b879ff69058 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:19:39.499962 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e9e98457-fcb0-4429-ae7e-6b879ff69058 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "DELETE /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 204 len: 0 microversion: 2.1 time: 0.124968 Jun 23 17:19:39.501176 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 403/820] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:19:39 2022] DELETE /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:19:39.509197 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-73706671-3a61-43a2-83bf-8c9597da5793 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:39.509883 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-73706671-3a61-43a2-83bf-8c9597da5793 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:39.516038 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-73706671-3a61-43a2-83bf-8c9597da5793 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:39.516481 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-73706671-3a61-43a2-83bf-8c9597da5793 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:39.517261 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-73706671-3a61-43a2-83bf-8c9597da5793 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:39.517694 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-73706671-3a61-43a2-83bf-8c9597da5793 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:39.738843 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-73706671-3a61-43a2-83bf-8c9597da5793 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:39.746761 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-73706671-3a61-43a2-83bf-8c9597da5793 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1691 microversion: 2.1 time: 0.241350 Jun 23 17:19:39.747565 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 418/821] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:39 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1691 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:40.765268 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bcc274d1-4f70-4ebd-b4a1-cd35efcfcba1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:40.765988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bcc274d1-4f70-4ebd-b4a1-cd35efcfcba1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:40.772911 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcc274d1-4f70-4ebd-b4a1-cd35efcfcba1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:40.773603 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcc274d1-4f70-4ebd-b4a1-cd35efcfcba1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:40.774609 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcc274d1-4f70-4ebd-b4a1-cd35efcfcba1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:40.775052 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcc274d1-4f70-4ebd-b4a1-cd35efcfcba1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:40.790837 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:41.269728 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bcc274d1-4f70-4ebd-b4a1-cd35efcfcba1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:41.278020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bcc274d1-4f70-4ebd-b4a1-cd35efcfcba1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1691 microversion: 2.1 time: 0.516967 Jun 23 17:19:41.278591 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 404/822] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:40 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1691 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:42.295191 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-69aa6ede-1e82-4707-908e-ac3dc3e4d46a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:42.295803 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-69aa6ede-1e82-4707-908e-ac3dc3e4d46a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:42.299928 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=44 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:42.303847 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-69aa6ede-1e82-4707-908e-ac3dc3e4d46a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:42.304636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-69aa6ede-1e82-4707-908e-ac3dc3e4d46a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:42.305458 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-69aa6ede-1e82-4707-908e-ac3dc3e4d46a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:42.306152 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-69aa6ede-1e82-4707-908e-ac3dc3e4d46a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:42.509985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-69aa6ede-1e82-4707-908e-ac3dc3e4d46a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:42.517755 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-69aa6ede-1e82-4707-908e-ac3dc3e4d46a tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1691 microversion: 2.1 time: 0.226694 Jun 23 17:19:42.518384 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 419/823] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:42 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1691 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:43.535736 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e43e60b6-083b-41b7-8533-88a686e00e32 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:43.536516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e43e60b6-083b-41b7-8533-88a686e00e32 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:43.551681 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e43e60b6-083b-41b7-8533-88a686e00e32 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:43.552906 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e43e60b6-083b-41b7-8533-88a686e00e32 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:43.553895 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e43e60b6-083b-41b7-8533-88a686e00e32 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:43.554831 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e43e60b6-083b-41b7-8533-88a686e00e32 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:43.858248 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e43e60b6-083b-41b7-8533-88a686e00e32 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:43.866262 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e43e60b6-083b-41b7-8533-88a686e00e32 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1691 microversion: 2.1 time: 0.334397 Jun 23 17:19:43.867312 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 405/824] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:43 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1691 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:44.703296 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-ae7bf6fb-45b7-49c0-81b6-a033a9230d5d req-c3670dfa-c69b-409a-8def-e2c11337bddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410f9789-fe14-436c-b928-5e32f1057008", "name": "network-vif-deleted", "tag": "3cb62c73-34be-4c1e-ac1b-34d0ab60dbbf"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:19:44.713385 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-ae7bf6fb-45b7-49c0-81b6-a033a9230d5d req-c3670dfa-c69b-409a-8def-e2c11337bddd service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:44.714235 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-ae7bf6fb-45b7-49c0-81b6-a033a9230d5d req-c3670dfa-c69b-409a-8def-e2c11337bddd service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:44.744089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-ae7bf6fb-45b7-49c0-81b6-a033a9230d5d req-c3670dfa-c69b-409a-8def-e2c11337bddd service nova] Creating event network-vif-deleted:3cb62c73-34be-4c1e-ac1b-34d0ab60dbbf for instance 410f9789-fe14-436c-b928-5e32f1057008 on hv-cinder-83538 Jun 23 17:19:44.749784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-ae7bf6fb-45b7-49c0-81b6-a033a9230d5d req-c3670dfa-c69b-409a-8def-e2c11337bddd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055379 Jun 23 17:19:44.756469 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 420/825] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:19:44.884620 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6e55290c-980a-4e1a-b289-122f77feb847 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:44.885343 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6e55290c-980a-4e1a-b289-122f77feb847 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:44.894230 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e55290c-980a-4e1a-b289-122f77feb847 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:44.895761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e55290c-980a-4e1a-b289-122f77feb847 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:44.897908 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e55290c-980a-4e1a-b289-122f77feb847 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:44.898774 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e55290c-980a-4e1a-b289-122f77feb847 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:44.972453 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e55290c-980a-4e1a-b289-122f77feb847 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:44.973260 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e55290c-980a-4e1a-b289-122f77feb847 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:44.973899 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-6e55290c-980a-4e1a-b289-122f77feb847 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lazy-loading 'fault' on Instance uuid 410f9789-fe14-436c-b928-5e32f1057008 {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:19:45.021938 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6e55290c-980a-4e1a-b289-122f77feb847 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:45.030242 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6e55290c-980a-4e1a-b289-122f77feb847 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 200 len: 1335 microversion: 2.1 time: 0.149865 Jun 23 17:19:45.031498 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 406/826] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:44 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 1335 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:46.049935 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5c20b1c4-934a-4b8d-83ac-c751116409a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:46.050607 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5c20b1c4-934a-4b8d-83ac-c751116409a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 410f9789-fe14-436c-b928-5e32f1057008] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:46.058107 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5c20b1c4-934a-4b8d-83ac-c751116409a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:46.058562 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5c20b1c4-934a-4b8d-83ac-c751116409a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:46.059331 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5c20b1c4-934a-4b8d-83ac-c751116409a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:46.059930 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5c20b1c4-934a-4b8d-83ac-c751116409a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:46.075428 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-5c20b1c4-934a-4b8d-83ac-c751116409a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] HTTP exception thrown: Instance 410f9789-fe14-436c-b928-5e32f1057008 could not be found. Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5c20b1c4-934a-4b8d-83ac-c751116409a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Request method failure captured: Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 HTTP/1.1 Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7mFXjOXoVpVDiV73DGaFoQ40dnVCIjXPuBt-YVKYyPM5lfbg2XseOWz8Hy8BcfTziAeJCIEfOhC6ANWOZDu7-5SMQaZLqZ9xDDe2MVgPKXO2USJmXiOEh-zZV6pl6aHTj4-U_og7W-dNSK8arRGdOb8W5jA06K1NkAAAQv7t6Km7w Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: bec9016d905e4d29b8e7c3f63c8a8810 Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:19:46.077100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:19:46.078554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bec9016d905e4d29b8e7c3f63c8a8810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bec9016d905e4d29b8e7c3f63c8a8810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bec9016d905e4d29b8e7c3f63c8a8810", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bec9016d905e4d29b8e7c3f63c8a8810"}]}] Jun 23 17:19:46.078554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:19:46.078554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: bec9016d905e4d29b8e7c3f63c8a8810 Jun 23 17:19:46.078554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:19:46.078554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-ServerRescueNegativeTestJSON-1610712579-project Jun 23 17:19:46.078554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:19:46.078554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:19:46.078554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: ccfccebbea724eca8909be4fea93a58f Jun 23 17:19:46.078554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1610712579-project Jun 23 17:19:46.078554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:19:46.078554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance 410f9789-fe14-436c-b928-5e32f1057008 could not be found. Jun 23 17:19:46.078554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '410f9789-fe14-436c-b928-5e32f1057008'} Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410f9789-fe14-436c-b928-5e32f1057008 could not be found. Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:19:46.079367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410f9789-fe14-436c-b928-5e32f1057008 could not be found. Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410f9789-fe14-436c-b928-5e32f1057008 could not be found. Jun 23 17:19:46.080667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:46.082061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5c20b1c4-934a-4b8d-83ac-c751116409a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Returning 404 to user: Instance 410f9789-fe14-436c-b928-5e32f1057008 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:19:46.082061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5c20b1c4-934a-4b8d-83ac-c751116409a9 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008" status: 404 len: 111 microversion: 2.1 time: 0.033651 Jun 23 17:19:46.082061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 421/827] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:46 2022] GET /compute/v2.1/servers/410f9789-fe14-436c-b928-5e32f1057008 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:19:46.092771 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7f58dcc1-2dcf-4987-ad62-ec034ef0af0b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '.version_select at 0x7f34323d2670>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:46.116559 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7f58dcc1-2dcf-4987-ad62-ec034ef0af0b tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-210919658" status: 202 len: 0 microversion: 2.1 time: 0.032593 Jun 23 17:19:46.117187 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 407/828] 10.222.0.18 () {58 vars in 1217 bytes} [Thu Jun 23 17:19:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-210919658 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:19:49.055540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-63bd9ca9-241b-43c7-b344-9fb7615ea251 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:49.056062 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-63bd9ca9-241b-43c7-b344-9fb7615ea251 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:49.063071 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-63bd9ca9-241b-43c7-b344-9fb7615ea251 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:49.063521 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-63bd9ca9-241b-43c7-b344-9fb7615ea251 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:49.064273 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-63bd9ca9-241b-43c7-b344-9fb7615ea251 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:49.064716 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-63bd9ca9-241b-43c7-b344-9fb7615ea251 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:49.090272 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-63bd9ca9-241b-43c7-b344-9fb7615ea251 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Going to try to terminate instance {{(pid=117897) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:19:49.138557 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:49.176604 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-63bd9ca9-241b-43c7-b344-9fb7615ea251 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "DELETE /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 204 len: 0 microversion: 2.1 time: 0.125087 Jun 23 17:19:49.177191 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 422/829] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:19:49 2022] DELETE /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:19:49.187481 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6efd2b33-2366-4868-a4c2-6a051a308a0d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:49.188090 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6efd2b33-2366-4868-a4c2-6a051a308a0d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:49.194968 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6efd2b33-2366-4868-a4c2-6a051a308a0d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:49.195443 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6efd2b33-2366-4868-a4c2-6a051a308a0d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:49.196263 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6efd2b33-2366-4868-a4c2-6a051a308a0d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:49.196845 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6efd2b33-2366-4868-a4c2-6a051a308a0d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:49.336503 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6efd2b33-2366-4868-a4c2-6a051a308a0d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:49.344413 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6efd2b33-2366-4868-a4c2-6a051a308a0d tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1508 microversion: 2.1 time: 0.161463 Jun 23 17:19:49.345000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 408/830] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:49 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:50.362753 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1f509b61-11be-4b61-b67e-f3e8fff93377 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:50.363324 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1f509b61-11be-4b61-b67e-f3e8fff93377 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:50.370314 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1f509b61-11be-4b61-b67e-f3e8fff93377 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:50.370762 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1f509b61-11be-4b61-b67e-f3e8fff93377 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:50.371522 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1f509b61-11be-4b61-b67e-f3e8fff93377 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:50.371963 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1f509b61-11be-4b61-b67e-f3e8fff93377 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:50.444821 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1f509b61-11be-4b61-b67e-f3e8fff93377 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:50.456485 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1f509b61-11be-4b61-b67e-f3e8fff93377 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 200 len: 1466 microversion: 2.1 time: 0.097949 Jun 23 17:19:50.457294 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 423/831] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:50 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 1466 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:50.494862 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-a218552d-dc3c-4193-ac7a-c35682c61a7e req-32d41c75-b742-4c69-a7c3-67732f797033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cdc2c3-760e-4876-86fc-3f85c50f0a31", "name": "network-vif-deleted", "tag": "3612ccfa-71a1-4cf4-800c-6c5428ab6f0e"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:19:50.504003 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-a218552d-dc3c-4193-ac7a-c35682c61a7e req-32d41c75-b742-4c69-a7c3-67732f797033 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:50.504443 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-a218552d-dc3c-4193-ac7a-c35682c61a7e req-32d41c75-b742-4c69-a7c3-67732f797033 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:50.515720 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-a218552d-dc3c-4193-ac7a-c35682c61a7e req-32d41c75-b742-4c69-a7c3-67732f797033 service nova] Creating event network-vif-deleted:3612ccfa-71a1-4cf4-800c-6c5428ab6f0e for instance 05cdc2c3-760e-4876-86fc-3f85c50f0a31 on hv-cinder-83538 Jun 23 17:19:50.520951 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-a218552d-dc3c-4193-ac7a-c35682c61a7e req-32d41c75-b742-4c69-a7c3-67732f797033 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029683 Jun 23 17:19:50.521699 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 409/832] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:19:51.477965 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-089de5b8-523c-40e6-b5e2-7dc836afe122 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:51.478886 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-089de5b8-523c-40e6-b5e2-7dc836afe122 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 05cdc2c3-760e-4876-86fc-3f85c50f0a31] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:51.489779 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-089de5b8-523c-40e6-b5e2-7dc836afe122 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:51.489779 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-089de5b8-523c-40e6-b5e2-7dc836afe122 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:51.490502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-089de5b8-523c-40e6-b5e2-7dc836afe122 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:51.490928 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-089de5b8-523c-40e6-b5e2-7dc836afe122 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:51.506512 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-089de5b8-523c-40e6-b5e2-7dc836afe122 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] HTTP exception thrown: Instance 05cdc2c3-760e-4876-86fc-3f85c50f0a31 could not be found. Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-089de5b8-523c-40e6-b5e2-7dc836afe122 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Request method failure captured: Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 HTTP/1.1 Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7mFXjOXoVpVDiV73DGaFoQ40dnVCIjXPuBt-YVKYyPM5lfbg2XseOWz8Hy8BcfTziAeJCIEfOhC6ANWOZDu7-5SMQaZLqZ9xDDe2MVgPKXO2USJmXiOEh-zZV6pl6aHTj4-U_og7W-dNSK8arRGdOb8W5jA06K1NkAAAQv7t6Km7w Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: bec9016d905e4d29b8e7c3f63c8a8810 Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:19:51.508135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:19:51.509551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bec9016d905e4d29b8e7c3f63c8a8810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bec9016d905e4d29b8e7c3f63c8a8810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bec9016d905e4d29b8e7c3f63c8a8810", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bec9016d905e4d29b8e7c3f63c8a8810"}]}] Jun 23 17:19:51.509551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:19:51.509551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: bec9016d905e4d29b8e7c3f63c8a8810 Jun 23 17:19:51.509551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:19:51.509551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-ServerRescueNegativeTestJSON-1610712579-project Jun 23 17:19:51.509551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:19:51.509551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:19:51.509551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: ccfccebbea724eca8909be4fea93a58f Jun 23 17:19:51.509551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1610712579-project Jun 23 17:19:51.509551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:19:51.509551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance 05cdc2c3-760e-4876-86fc-3f85c50f0a31 could not be found. Jun 23 17:19:51.509551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '05cdc2c3-760e-4876-86fc-3f85c50f0a31'} Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05cdc2c3-760e-4876-86fc-3f85c50f0a31 could not be found. Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:19:51.510309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05cdc2c3-760e-4876-86fc-3f85c50f0a31 could not be found. Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05cdc2c3-760e-4876-86fc-3f85c50f0a31 could not be found. Jun 23 17:19:51.511606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:19:51.512934 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-089de5b8-523c-40e6-b5e2-7dc836afe122 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Returning 404 to user: Instance 05cdc2c3-760e-4876-86fc-3f85c50f0a31 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:19:51.512934 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-089de5b8-523c-40e6-b5e2-7dc836afe122 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31" status: 404 len: 111 microversion: 2.1 time: 0.038332 Jun 23 17:19:51.512934 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 424/833] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:51 2022] GET /compute/v2.1/servers/05cdc2c3-760e-4876-86fc-3f85c50f0a31 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:19:51.519222 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8e479b20-8860-4fa4-968f-45e7dd2736a1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:51.519896 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8e479b20-8860-4fa4-968f-45e7dd2736a1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:51.526771 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e479b20-8860-4fa4-968f-45e7dd2736a1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:51.527214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e479b20-8860-4fa4-968f-45e7dd2736a1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:51.527972 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e479b20-8860-4fa4-968f-45e7dd2736a1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:51.528405 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e479b20-8860-4fa4-968f-45e7dd2736a1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:51.554725 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8e479b20-8860-4fa4-968f-45e7dd2736a1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:19:51.642006 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8e479b20-8860-4fa4-968f-45e7dd2736a1 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "DELETE /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 204 len: 0 microversion: 2.1 time: 0.127273 Jun 23 17:19:51.642582 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 410/834] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:19:51 2022] DELETE /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:19:51.650849 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ddbf6d0a-3de7-4c43-90da-5545327f8e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:51.651464 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ddbf6d0a-3de7-4c43-90da-5545327f8e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:51.657659 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ddbf6d0a-3de7-4c43-90da-5545327f8e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:51.658141 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ddbf6d0a-3de7-4c43-90da-5545327f8e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:51.658894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ddbf6d0a-3de7-4c43-90da-5545327f8e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:51.659328 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ddbf6d0a-3de7-4c43-90da-5545327f8e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:51.792672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ddbf6d0a-3de7-4c43-90da-5545327f8e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:51.804369 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ddbf6d0a-3de7-4c43-90da-5545327f8e46 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.156760 Jun 23 17:19:51.810015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 425/835] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:51 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:19:52.833861 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0304f3ae-0154-4ef7-9b37-8fea2e002d19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:52.835048 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0304f3ae-0154-4ef7-9b37-8fea2e002d19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:52.846042 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0304f3ae-0154-4ef7-9b37-8fea2e002d19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:52.846782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0304f3ae-0154-4ef7-9b37-8fea2e002d19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:52.848277 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0304f3ae-0154-4ef7-9b37-8fea2e002d19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:52.848714 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0304f3ae-0154-4ef7-9b37-8fea2e002d19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:52.986214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0304f3ae-0154-4ef7-9b37-8fea2e002d19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:52.994336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0304f3ae-0154-4ef7-9b37-8fea2e002d19 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.167869 Jun 23 17:19:52.994884 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 411/836] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:52 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:54.015618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-27a288a6-85f9-4b19-abe3-785a14215509 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:54.016560 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-27a288a6-85f9-4b19-abe3-785a14215509 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:54.027645 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-27a288a6-85f9-4b19-abe3-785a14215509 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:54.028389 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-27a288a6-85f9-4b19-abe3-785a14215509 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:54.029647 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-27a288a6-85f9-4b19-abe3-785a14215509 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:54.030446 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-27a288a6-85f9-4b19-abe3-785a14215509 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:54.163717 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-27a288a6-85f9-4b19-abe3-785a14215509 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:54.171596 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-27a288a6-85f9-4b19-abe3-785a14215509 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1523 microversion: 2.1 time: 0.162681 Jun 23 17:19:54.172159 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 426/837] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:54 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:54.899160 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-10248a5b-f28f-4f4b-b85a-4d09110c900f req-e04b90a4-a44e-4731-b827-3084a89bff36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "517df8d9-1e33-4448-a439-8ea166866a32", "name": "network-vif-deleted", "tag": "48141e67-5b25-450e-90a9-9f9ac8cb4882"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:19:54.907988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-10248a5b-f28f-4f4b-b85a-4d09110c900f req-e04b90a4-a44e-4731-b827-3084a89bff36 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:54.908446 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-10248a5b-f28f-4f4b-b85a-4d09110c900f req-e04b90a4-a44e-4731-b827-3084a89bff36 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:54.920771 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-10248a5b-f28f-4f4b-b85a-4d09110c900f req-e04b90a4-a44e-4731-b827-3084a89bff36 service nova] Creating event network-vif-deleted:48141e67-5b25-450e-90a9-9f9ac8cb4882 for instance 517df8d9-1e33-4448-a439-8ea166866a32 on hv-cinder-83538 Jun 23 17:19:54.925721 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-10248a5b-f28f-4f4b-b85a-4d09110c900f req-e04b90a4-a44e-4731-b827-3084a89bff36 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030623 Jun 23 17:19:54.926633 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 412/838] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:19:55.188927 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-80eeb1f2-ce67-4698-9621-bf78f8b70a86 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:55.189641 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-80eeb1f2-ce67-4698-9621-bf78f8b70a86 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:55.202035 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-80eeb1f2-ce67-4698-9621-bf78f8b70a86 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:55.202579 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-80eeb1f2-ce67-4698-9621-bf78f8b70a86 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:55.203377 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-80eeb1f2-ce67-4698-9621-bf78f8b70a86 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:55.203810 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-80eeb1f2-ce67-4698-9621-bf78f8b70a86 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:55.240829 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-80eeb1f2-ce67-4698-9621-bf78f8b70a86 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:55.241280 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-80eeb1f2-ce67-4698-9621-bf78f8b70a86 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:55.241721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-80eeb1f2-ce67-4698-9621-bf78f8b70a86 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lazy-loading 'fault' on Instance uuid 517df8d9-1e33-4448-a439-8ea166866a32 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:19:55.294148 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-80eeb1f2-ce67-4698-9621-bf78f8b70a86 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccfccebbea724eca8909be4fea93a58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec9016d905e4d29b8e7c3f63c8a8810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:19:55.304694 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-80eeb1f2-ce67-4698-9621-bf78f8b70a86 tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 200 len: 1312 microversion: 2.1 time: 0.119370 Jun 23 17:19:55.305283 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 427/839] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:55 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:19:56.328446 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-78775a75-98f8-48e8-ab81-3c356d680c2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:19:56.329581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-78775a75-98f8-48e8-ab81-3c356d680c2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] [instance: 517df8d9-1e33-4448-a439-8ea166866a32] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:19:56.340457 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78775a75-98f8-48e8-ab81-3c356d680c2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:56.341232 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78775a75-98f8-48e8-ab81-3c356d680c2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:56.342562 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78775a75-98f8-48e8-ab81-3c356d680c2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:19:56.343258 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78775a75-98f8-48e8-ab81-3c356d680c2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:19:56.359026 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-78775a75-98f8-48e8-ab81-3c356d680c2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] HTTP exception thrown: Instance 517df8d9-1e33-4448-a439-8ea166866a32 could not be found. Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-78775a75-98f8-48e8-ab81-3c356d680c2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Request method failure captured: Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 HTTP/1.1 Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ7mFXjOXoVpVDiV73DGaFoQ40dnVCIjXPuBt-YVKYyPM5lfbg2XseOWz8Hy8BcfTziAeJCIEfOhC6ANWOZDu7-5SMQaZLqZ9xDDe2MVgPKXO2USJmXiOEh-zZV6pl6aHTj4-U_og7W-dNSK8arRGdOb8W5jA06K1NkAAAQv7t6Km7w Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: bec9016d905e4d29b8e7c3f63c8a8810 Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:19:56.360631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:19:56.362066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bec9016d905e4d29b8e7c3f63c8a8810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bec9016d905e4d29b8e7c3f63c8a8810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bec9016d905e4d29b8e7c3f63c8a8810", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bec9016d905e4d29b8e7c3f63c8a8810"}]}] Jun 23 17:19:56.362066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:19:56.362066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: bec9016d905e4d29b8e7c3f63c8a8810 Jun 23 17:19:56.362066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1610712579 Jun 23 17:19:56.362066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-ServerRescueNegativeTestJSON-1610712579-project Jun 23 17:19:56.362066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:19:56.362066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:19:56.362066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: ccfccebbea724eca8909be4fea93a58f Jun 23 17:19:56.362066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1610712579-project Jun 23 17:19:56.362066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:19:56.362066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 517df8d9-1e33-4448-a439-8ea166866a32 could not be found. Jun 23 17:19:56.362066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '517df8d9-1e33-4448-a439-8ea166866a32'} Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 517df8d9-1e33-4448-a439-8ea166866a32 could not be found. Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:19:56.362814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 517df8d9-1e33-4448-a439-8ea166866a32 could not be found. Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 517df8d9-1e33-4448-a439-8ea166866a32 could not be found. Jun 23 17:19:56.364035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:19:56.365153 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-78775a75-98f8-48e8-ab81-3c356d680c2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] Returning 404 to user: Instance 517df8d9-1e33-4448-a439-8ea166866a32 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:19:56.365153 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-78775a75-98f8-48e8-ab81-3c356d680c2c tempest-ServerRescueNegativeTestJSON-1610712579 tempest-ServerRescueNegativeTestJSON-1610712579-project] 10.222.0.18 "GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32" status: 404 len: 111 microversion: 2.1 time: 0.041543 Jun 23 17:19:56.365153 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 413/840] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:19:56 2022] GET /compute/v2.1/servers/517df8d9-1e33-4448-a439-8ea166866a32 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:20:04.940911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1e731d2b-c686-4f69-a08c-803b95aea254 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Action: 'create', calling method: .version_select at 0x7f342da865e0>, body: {"keypair": {"name": "tempest-keypair-1510774818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDS7QQg0YtLkC3xYsHvb65gLpS0sRmzdtaXF5+awELblDFtkyn9hZc7XDK6CjhQpnK9NtjCwLrEziX96YLSKGyh7vFa6vWcPs8sVUmYEDtxfdFT3ukE5Ap4hvdMWXMwsMA=="}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:04.957613 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-1e731d2b-c686-4f69-a08c-803b95aea254 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Getting quotas for project e2d73f7bfc184cacb49809a89563b585. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:20:04.964280 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-1e731d2b-c686-4f69-a08c-803b95aea254 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Getting quotas for user 4b43fe7da444445fbffb6158d332d99d and project e2d73f7bfc184cacb49809a89563b585. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:20:04.994151 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1e731d2b-c686-4f69-a08c-803b95aea254 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.173294 Jun 23 17:20:04.994765 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 428/841] 10.222.0.18 () {62 vars in 1199 bytes} [Thu Jun 23 17:20:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 17:20:06.361263 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1271944885", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d11fc20-78b8-4593-ad26-eda404da60a9"}], "security_groups": [{"name": "tempest-securitygroup--97066102"}], "key_name": "tempest-keypair-1510774818", "user_data": "}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:06.368745 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:06.369389 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:06.471515 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] validate_networks() for [('1d11fc20-78b8-4593-ad26-eda404da60a9', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:20:07.106950 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:20:07.107446 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:20:07.107919 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:20:07.108325 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:20:07.108731 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:20:07.118350 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:07.118801 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:07.119592 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:07.120027 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:07.137104 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Getting quotas for project e2d73f7bfc184cacb49809a89563b585. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:20:07.141056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Getting quotas for user 4b43fe7da444445fbffb6158d332d99d and project e2d73f7bfc184cacb49809a89563b585. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:20:07.152276 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:20:07.154619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:20:07.203512 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e2aba651-d52f-4e66-86d9-a80a2dafcc87 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.846729 Jun 23 17:20:07.209244 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 414/842] 10.222.0.18 () {62 vars in 1187 bytes} [Thu Jun 23 17:20:06 2022] POST /compute/v2.1/servers => generated 400 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 17:20:07.211585 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:07.216858 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1f063020-d22b-4485-a8a3-a3ecb5b805bc tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:07.217530 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1f063020-d22b-4485-a8a3-a3ecb5b805bc tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:07.288771 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1f063020-d22b-4485-a8a3-a3ecb5b805bc tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:07.299220 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1f063020-d22b-4485-a8a3-a3ecb5b805bc tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:07.301084 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1f063020-d22b-4485-a8a3-a3ecb5b805bc tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:07.301882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1f063020-d22b-4485-a8a3-a3ecb5b805bc tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1282 microversion: 2.20 time: 0.091244 Jun 23 17:20:07.302812 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 429/843] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:20:07 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:20:08.322193 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-94f3b3f3-47ef-412d-bbd1-f2ea9f9d27da tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:08.322870 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-94f3b3f3-47ef-412d-bbd1-f2ea9f9d27da tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:08.330107 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-94f3b3f3-47ef-412d-bbd1-f2ea9f9d27da tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:08.330817 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-94f3b3f3-47ef-412d-bbd1-f2ea9f9d27da tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:08.331597 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-94f3b3f3-47ef-412d-bbd1-f2ea9f9d27da tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:08.332127 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-94f3b3f3-47ef-412d-bbd1-f2ea9f9d27da tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:08.415375 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-94f3b3f3-47ef-412d-bbd1-f2ea9f9d27da tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:08.425856 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-94f3b3f3-47ef-412d-bbd1-f2ea9f9d27da tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:08.428324 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-94f3b3f3-47ef-412d-bbd1-f2ea9f9d27da tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:08.430051 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-94f3b3f3-47ef-412d-bbd1-f2ea9f9d27da tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1342 microversion: 2.20 time: 0.113355 Jun 23 17:20:08.430781 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 415/844] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:20:08 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1342 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:20:09.448829 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b93a6ec9-7b96-41db-8589-1a9251c771b9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:09.449560 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b93a6ec9-7b96-41db-8589-1a9251c771b9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:09.456045 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b93a6ec9-7b96-41db-8589-1a9251c771b9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:09.456798 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b93a6ec9-7b96-41db-8589-1a9251c771b9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:09.457713 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b93a6ec9-7b96-41db-8589-1a9251c771b9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:09.458363 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b93a6ec9-7b96-41db-8589-1a9251c771b9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:09.604027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b93a6ec9-7b96-41db-8589-1a9251c771b9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:09.612531 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b93a6ec9-7b96-41db-8589-1a9251c771b9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:09.614323 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b93a6ec9-7b96-41db-8589-1a9251c771b9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:09.615628 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b93a6ec9-7b96-41db-8589-1a9251c771b9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1406 microversion: 2.20 time: 0.170889 Jun 23 17:20:09.616352 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 430/845] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:20:09 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:20:09.964143 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-3761b520-6fbe-4193-83d1-4e9af44314bd req-c9eac7e5-fb4b-4143-ae92-e6608fe787c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65320df8-ae02-4a62-bde7-14088815afcb", "tag": "d460160b-555d-4087-b187-9075bf3d3b97"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:09.982398 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-3761b520-6fbe-4193-83d1-4e9af44314bd req-c9eac7e5-fb4b-4143-ae92-e6608fe787c2 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:09.982841 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-3761b520-6fbe-4193-83d1-4e9af44314bd req-c9eac7e5-fb4b-4143-ae92-e6608fe787c2 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:09.998762 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-3761b520-6fbe-4193-83d1-4e9af44314bd req-c9eac7e5-fb4b-4143-ae92-e6608fe787c2 service nova] Creating event network-changed:d460160b-555d-4087-b187-9075bf3d3b97 for instance 65320df8-ae02-4a62-bde7-14088815afcb on hv-cinder-83538 Jun 23 17:20:10.005950 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-3761b520-6fbe-4193-83d1-4e9af44314bd req-c9eac7e5-fb4b-4143-ae92-e6608fe787c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047202 Jun 23 17:20:10.006585 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 416/846] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:20:10.634957 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-705adc5b-9c93-44b0-a5d3-9805e3960a37 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:10.635555 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-705adc5b-9c93-44b0-a5d3-9805e3960a37 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:10.642536 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-705adc5b-9c93-44b0-a5d3-9805e3960a37 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:10.642977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-705adc5b-9c93-44b0-a5d3-9805e3960a37 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:10.643723 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-705adc5b-9c93-44b0-a5d3-9805e3960a37 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:10.644148 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-705adc5b-9c93-44b0-a5d3-9805e3960a37 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:10.781777 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-705adc5b-9c93-44b0-a5d3-9805e3960a37 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:10.791270 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-705adc5b-9c93-44b0-a5d3-9805e3960a37 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:10.792767 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-705adc5b-9c93-44b0-a5d3-9805e3960a37 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:10.793890 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-705adc5b-9c93-44b0-a5d3-9805e3960a37 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1406 microversion: 2.20 time: 0.162899 Jun 23 17:20:10.794421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 431/847] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:20:10 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:20:11.815977 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-697502a3-f1e5-467c-898c-12b6c3d082af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:11.816974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-697502a3-f1e5-467c-898c-12b6c3d082af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:11.826290 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-697502a3-f1e5-467c-898c-12b6c3d082af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:11.826727 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-697502a3-f1e5-467c-898c-12b6c3d082af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:11.827515 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-697502a3-f1e5-467c-898c-12b6c3d082af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:11.827939 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-697502a3-f1e5-467c-898c-12b6c3d082af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:11.974375 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-697502a3-f1e5-467c-898c-12b6c3d082af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:11.986641 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-697502a3-f1e5-467c-898c-12b6c3d082af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:11.988814 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-697502a3-f1e5-467c-898c-12b6c3d082af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:11.989932 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-697502a3-f1e5-467c-898c-12b6c3d082af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1406 microversion: 2.20 time: 0.180625 Jun 23 17:20:11.990493 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 417/848] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:20:11 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:20:13.007633 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9a5539fc-66cf-4922-b883-6513b3c3dee9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:13.008295 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9a5539fc-66cf-4922-b883-6513b3c3dee9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:13.010735 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:13.016203 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9a5539fc-66cf-4922-b883-6513b3c3dee9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:13.016647 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9a5539fc-66cf-4922-b883-6513b3c3dee9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:13.017462 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9a5539fc-66cf-4922-b883-6513b3c3dee9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:13.017920 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9a5539fc-66cf-4922-b883-6513b3c3dee9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:13.149298 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9a5539fc-66cf-4922-b883-6513b3c3dee9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:13.157967 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9a5539fc-66cf-4922-b883-6513b3c3dee9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:13.159559 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9a5539fc-66cf-4922-b883-6513b3c3dee9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:13.160762 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9a5539fc-66cf-4922-b883-6513b3c3dee9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1406 microversion: 2.20 time: 0.157456 Jun 23 17:20:13.161438 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 432/849] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:20:13 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:20:13.637549 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d406302f-1526-4645-a14e-99105a2c97ca tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:13.638190 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d406302f-1526-4645-a14e-99105a2c97ca tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:13.645082 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d406302f-1526-4645-a14e-99105a2c97ca tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:13.645534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d406302f-1526-4645-a14e-99105a2c97ca tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:13.646611 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d406302f-1526-4645-a14e-99105a2c97ca tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:13.647165 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d406302f-1526-4645-a14e-99105a2c97ca tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:13.671225 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d406302f-1526-4645-a14e-99105a2c97ca tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/ips" status: 200 len: 150 microversion: 2.1 time: 0.037566 Jun 23 17:20:13.671798 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 418/850] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 23 17:20:13 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:20:14.181778 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c61abfb3-c76b-47b9-b758-889eec8c3840 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:14.182446 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c61abfb3-c76b-47b9-b758-889eec8c3840 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:14.189019 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c61abfb3-c76b-47b9-b758-889eec8c3840 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:14.189467 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c61abfb3-c76b-47b9-b758-889eec8c3840 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:14.190278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c61abfb3-c76b-47b9-b758-889eec8c3840 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:14.190717 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c61abfb3-c76b-47b9-b758-889eec8c3840 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:14.324967 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c61abfb3-c76b-47b9-b758-889eec8c3840 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:14.333391 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c61abfb3-c76b-47b9-b758-889eec8c3840 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:14.335069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c61abfb3-c76b-47b9-b758-889eec8c3840 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:14.336165 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c61abfb3-c76b-47b9-b758-889eec8c3840 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1406 microversion: 2.20 time: 0.159856 Jun 23 17:20:14.336766 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 433/851] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:20:14 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:20:15.007514 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0aec83c2-cc64-440c-aec2-0da51f296320 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "324082ef-72ba-4c30-b5a1-7015ca58fc7d"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:15.008683 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0aec83c2-cc64-440c-aec2-0da51f296320 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:15.015411 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0aec83c2-cc64-440c-aec2-0da51f296320 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:15.015866 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0aec83c2-cc64-440c-aec2-0da51f296320 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:15.016633 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0aec83c2-cc64-440c-aec2-0da51f296320 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:15.017068 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0aec83c2-cc64-440c-aec2-0da51f296320 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:15.310361 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0aec83c2-cc64-440c-aec2-0da51f296320 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "POST /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308783 Jun 23 17:20:15.311765 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 419/852] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 23 17:20:14 2022] POST /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:20:15.358562 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5e1078b7-c198-43cd-9593-d0a152b5a404 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:15.367493 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5e1078b7-c198-43cd-9593-d0a152b5a404 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:15.374362 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5e1078b7-c198-43cd-9593-d0a152b5a404 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:15.374813 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5e1078b7-c198-43cd-9593-d0a152b5a404 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:15.375578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5e1078b7-c198-43cd-9593-d0a152b5a404 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:15.376012 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5e1078b7-c198-43cd-9593-d0a152b5a404 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:15.524997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5e1078b7-c198-43cd-9593-d0a152b5a404 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:15.533377 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5e1078b7-c198-43cd-9593-d0a152b5a404 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:15.535188 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5e1078b7-c198-43cd-9593-d0a152b5a404 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:15.536290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5e1078b7-c198-43cd-9593-d0a152b5a404 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1406 microversion: 2.20 time: 0.181823 Jun 23 17:20:15.536911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 434/853] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:20:15 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:20:16.560679 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bf32d183-f782-4132-873a-70197cd4754d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:16.561902 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bf32d183-f782-4132-873a-70197cd4754d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:16.572751 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bf32d183-f782-4132-873a-70197cd4754d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:16.573200 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bf32d183-f782-4132-873a-70197cd4754d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:16.574015 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bf32d183-f782-4132-873a-70197cd4754d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:16.574449 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bf32d183-f782-4132-873a-70197cd4754d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:16.707879 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bf32d183-f782-4132-873a-70197cd4754d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:16.716146 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bf32d183-f782-4132-873a-70197cd4754d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:16.717637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bf32d183-f782-4132-873a-70197cd4754d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:16.718761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bf32d183-f782-4132-873a-70197cd4754d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1406 microversion: 2.20 time: 0.166240 Jun 23 17:20:16.719354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 420/854] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:20:16 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:20:17.534400 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-e4565142-51cb-4b2e-b96f-b20537a5ae07 req-15f8f408-701c-491e-9422-82a23ef54eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65320df8-ae02-4a62-bde7-14088815afcb", "name": "network-vif-plugged", "status": "completed", "tag": "d460160b-555d-4087-b187-9075bf3d3b97"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:17.538609 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=6 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:17.545145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-e4565142-51cb-4b2e-b96f-b20537a5ae07 req-15f8f408-701c-491e-9422-82a23ef54eb8 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:17.545729 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-e4565142-51cb-4b2e-b96f-b20537a5ae07 req-15f8f408-701c-491e-9422-82a23ef54eb8 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:17.558244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-e4565142-51cb-4b2e-b96f-b20537a5ae07 req-15f8f408-701c-491e-9422-82a23ef54eb8 service nova] Creating event network-vif-plugged:d460160b-555d-4087-b187-9075bf3d3b97 for instance 65320df8-ae02-4a62-bde7-14088815afcb on hv-cinder-83538 Jun 23 17:20:17.563162 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-e4565142-51cb-4b2e-b96f-b20537a5ae07 req-15f8f408-701c-491e-9422-82a23ef54eb8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032725 Jun 23 17:20:17.563754 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 435/855] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:20:17.737147 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1151d42c-b327-457c-bd7f-789b2e9fab4e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:17.737827 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1151d42c-b327-457c-bd7f-789b2e9fab4e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:17.740333 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:17.740960 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:17.747354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1151d42c-b327-457c-bd7f-789b2e9fab4e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:17.747805 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1151d42c-b327-457c-bd7f-789b2e9fab4e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:17.748580 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1151d42c-b327-457c-bd7f-789b2e9fab4e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:17.749019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1151d42c-b327-457c-bd7f-789b2e9fab4e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:17.929658 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1151d42c-b327-457c-bd7f-789b2e9fab4e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:17.942611 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1151d42c-b327-457c-bd7f-789b2e9fab4e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:17.944706 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1151d42c-b327-457c-bd7f-789b2e9fab4e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:17.946114 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1151d42c-b327-457c-bd7f-789b2e9fab4e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1406 microversion: 2.20 time: 0.213046 Jun 23 17:20:17.946678 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 421/856] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:20:17 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:20:18.969770 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3cadbd01-1233-45cb-aaf8-0eaea25e54af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:18.970877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3cadbd01-1233-45cb-aaf8-0eaea25e54af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:18.980108 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3cadbd01-1233-45cb-aaf8-0eaea25e54af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:18.980553 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3cadbd01-1233-45cb-aaf8-0eaea25e54af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:18.981311 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3cadbd01-1233-45cb-aaf8-0eaea25e54af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:18.981736 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3cadbd01-1233-45cb-aaf8-0eaea25e54af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:19.120508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3cadbd01-1233-45cb-aaf8-0eaea25e54af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:19.133400 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3cadbd01-1233-45cb-aaf8-0eaea25e54af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:19.135592 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3cadbd01-1233-45cb-aaf8-0eaea25e54af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:19.136685 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3cadbd01-1233-45cb-aaf8-0eaea25e54af tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1406 microversion: 2.20 time: 0.174234 Jun 23 17:20:19.137501 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 436/857] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:20:18 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:20:20.159867 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5777ca22-3c04-4c84-bf40-2539c4744b88 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:20.160854 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5777ca22-3c04-4c84-bf40-2539c4744b88 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:20.170025 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5777ca22-3c04-4c84-bf40-2539c4744b88 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:20.170472 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5777ca22-3c04-4c84-bf40-2539c4744b88 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:20.171325 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5777ca22-3c04-4c84-bf40-2539c4744b88 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:20.171763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5777ca22-3c04-4c84-bf40-2539c4744b88 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:20.317891 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5777ca22-3c04-4c84-bf40-2539c4744b88 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:20.327156 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5777ca22-3c04-4c84-bf40-2539c4744b88 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:20.328700 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5777ca22-3c04-4c84-bf40-2539c4744b88 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:20.329883 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5777ca22-3c04-4c84-bf40-2539c4744b88 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1598 microversion: 2.20 time: 0.176675 Jun 23 17:20:20.330454 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 422/858] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:20:20 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1598 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:20:20.355274 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f918c0f1-0cda-475c-a728-2dbf26e9fddf tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:20.355805 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f918c0f1-0cda-475c-a728-2dbf26e9fddf tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:20.363013 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f918c0f1-0cda-475c-a728-2dbf26e9fddf tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:20.363451 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f918c0f1-0cda-475c-a728-2dbf26e9fddf tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:20.364460 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f918c0f1-0cda-475c-a728-2dbf26e9fddf tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:20.364887 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f918c0f1-0cda-475c-a728-2dbf26e9fddf tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:20.443440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f918c0f1-0cda-475c-a728-2dbf26e9fddf tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092509 Jun 23 17:20:20.444061 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 437/859] 10.222.0.18 () {60 vars in 1315 bytes} [Thu Jun 23 17:20:20 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:20:21.393074 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-81551532-9dc0-456d-97d5-83a870e32993 req-f21361c0-4180-4601-a2fc-414ff2591c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65320df8-ae02-4a62-bde7-14088815afcb", "tag": "d460160b-555d-4087-b187-9075bf3d3b97"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:21.402012 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-81551532-9dc0-456d-97d5-83a870e32993 req-f21361c0-4180-4601-a2fc-414ff2591c9d service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:21.402452 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-81551532-9dc0-456d-97d5-83a870e32993 req-f21361c0-4180-4601-a2fc-414ff2591c9d service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:21.413493 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-81551532-9dc0-456d-97d5-83a870e32993 req-f21361c0-4180-4601-a2fc-414ff2591c9d service nova] Creating event network-changed:d460160b-555d-4087-b187-9075bf3d3b97 for instance 65320df8-ae02-4a62-bde7-14088815afcb on hv-cinder-83538 Jun 23 17:20:21.418566 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-81551532-9dc0-456d-97d5-83a870e32993 req-f21361c0-4180-4601-a2fc-414ff2591c9d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029176 Jun 23 17:20:21.419158 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 423/860] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:20:22.837635 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ae680ad9-68fa-47f6-82dd-ea2b397484bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "324082ef-72ba-4c30-b5a1-7015ca58fc7d"}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:22.838725 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ae680ad9-68fa-47f6-82dd-ea2b397484bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:22.845048 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ae680ad9-68fa-47f6-82dd-ea2b397484bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:22.845489 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ae680ad9-68fa-47f6-82dd-ea2b397484bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:22.846287 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ae680ad9-68fa-47f6-82dd-ea2b397484bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:22.846713 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ae680ad9-68fa-47f6-82dd-ea2b397484bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:22.938233 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-ae680ad9-68fa-47f6-82dd-ea2b397484bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] HTTP exception thrown: Invalid volume: volume 324082ef-72ba-4c30-b5a1-7015ca58fc7d is already attached to instances: 51605a4b-853e-479f-a3e6-f09880c23d5b Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ae680ad9-68fa-47f6-82dd-ea2b397484bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Request method failure captured: Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: POST /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/os-volume_attachments HTTP/1.1 Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 74 Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7iwY6C5zaqNRYLxueUq43muN0MHe54Fc4Vi8vUs_FNvBOzPmyPl2Y8AX6pFx2OI3hqvDvcKTZrFu8kIfpY_ykWG-5HAqbUcRHhG3HFFYy7PKAmD1gcfEdkk0kUs8MeaKA3KSx5FzNY4j9As2Ih8lkR3_iOjjcRNTH7mXCIBr57mgM Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:20:22.940003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:20:22.941535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_201cf53eaff642e78cf394182b0b9972", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}] Jun 23 17:20:22.941535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:20:22.941535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:20:22.941535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:20:22.941535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:20:22.941535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:20:22.941535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:20:22.941535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: fc6a4d6c1f834720a69ee30d5ae63cc9 Jun 23 17:20:22.941535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:20:22.941535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Jun 23 17:20:22.941535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {"volumeAttachment": {"volumeId": "324082ef-72ba-4c30-b5a1-7015ca58fc7d"}} Jun 23 17:20:22.941535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Invalid volume: volume 324082ef-72ba-4c30-b5a1-7015ca58fc7d is already attached to instances: 51605a4b-853e-479f-a3e6-f09880c23d5b Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'server_id': '51605a4b-853e-479f-a3e6-f09880c23d5b', 'body': {'volumeAttachment': {'volumeId': '324082ef-72ba-4c30-b5a1-7015ca58fc7d'}}} Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 324082ef-72ba-4c30-b5a1-7015ca58fc7d is already attached to instances: 51605a4b-853e-479f-a3e6-f09880c23d5b Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:22.942407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 324082ef-72ba-4c30-b5a1-7015ca58fc7d is already attached to instances: 51605a4b-853e-479f-a3e6-f09880c23d5b Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:20:22.943611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:20:22.944825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:20:22.944825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:20:22.944825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:20:22.944825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 324082ef-72ba-4c30-b5a1-7015ca58fc7d is already attached to instances: 51605a4b-853e-479f-a3e6-f09880c23d5b Jun 23 17:20:22.944825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:22.944825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ae680ad9-68fa-47f6-82dd-ea2b397484bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Returning 400 to user: Invalid volume: volume 324082ef-72ba-4c30-b5a1-7015ca58fc7d is already attached to instances: 51605a4b-853e-479f-a3e6-f09880c23d5b {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:20:22.944825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ae680ad9-68fa-47f6-82dd-ea2b397484bd tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "POST /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108438 Jun 23 17:20:22.944825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 438/861] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 23 17:20:22 2022] POST /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 17:20:23.007450 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-04b823fd-09c6-4a24-bfbb-1e1fbd4102df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:23.008188 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-04b823fd-09c6-4a24-bfbb-1e1fbd4102df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:23.017167 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04b823fd-09c6-4a24-bfbb-1e1fbd4102df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:23.017769 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04b823fd-09c6-4a24-bfbb-1e1fbd4102df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:23.018945 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04b823fd-09c6-4a24-bfbb-1e1fbd4102df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:23.019540 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04b823fd-09c6-4a24-bfbb-1e1fbd4102df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:23.104795 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-04b823fd-09c6-4a24-bfbb-1e1fbd4102df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lazy-loading 'services' on Instance uuid 51605a4b-853e-479f-a3e6-f09880c23d5b {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:20:23.225890 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-04b823fd-09c6-4a24-bfbb-1e1fbd4102df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/os-volume_attachments/324082ef-72ba-4c30-b5a1-7015ca58fc7d" status: 202 len: 0 microversion: 2.1 time: 0.226014 Jun 23 17:20:23.226564 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 424/862] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 23 17:20:22 2022] DELETE /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/os-volume_attachments/324082ef-72ba-4c30-b5a1-7015ca58fc7d => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:20:23.235458 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9b0beaf9-2d29-4e12-b813-3aad46d5e2af tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:23.236535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9b0beaf9-2d29-4e12-b813-3aad46d5e2af tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:23.243718 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9b0beaf9-2d29-4e12-b813-3aad46d5e2af tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:23.244244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9b0beaf9-2d29-4e12-b813-3aad46d5e2af tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:23.245232 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9b0beaf9-2d29-4e12-b813-3aad46d5e2af tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:23.245642 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9b0beaf9-2d29-4e12-b813-3aad46d5e2af tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:23.276141 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9b0beaf9-2d29-4e12-b813-3aad46d5e2af tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044557 Jun 23 17:20:23.276704 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 439/863] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:20:23 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:20:24.289296 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a0977b46-0dce-4b84-baf4-ecc41deb955c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:24.290641 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a0977b46-0dce-4b84-baf4-ecc41deb955c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:24.297934 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0977b46-0dce-4b84-baf4-ecc41deb955c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:24.298380 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0977b46-0dce-4b84-baf4-ecc41deb955c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:24.299148 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0977b46-0dce-4b84-baf4-ecc41deb955c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:24.299650 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0977b46-0dce-4b84-baf4-ecc41deb955c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:24.330200 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a0977b46-0dce-4b84-baf4-ecc41deb955c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045446 Jun 23 17:20:24.330744 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 425/864] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:20:24 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 17:20:24.396675 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6177093d-f07b-4772-b9d1-7462571dec53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:24.397200 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6177093d-f07b-4772-b9d1-7462571dec53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:24.406112 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6177093d-f07b-4772-b9d1-7462571dec53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:24.406670 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6177093d-f07b-4772-b9d1-7462571dec53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:24.407855 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6177093d-f07b-4772-b9d1-7462571dec53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:24.408501 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6177093d-f07b-4772-b9d1-7462571dec53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:24.442987 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6177093d-f07b-4772-b9d1-7462571dec53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Going to try to terminate instance {{(pid=117897) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:20:24.531455 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6177093d-f07b-4772-b9d1-7462571dec53 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 204 len: 0 microversion: 2.1 time: 0.138414 Jun 23 17:20:24.532037 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 440/865] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:20:24 2022] DELETE /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:20:24.540519 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c35c0f28-2437-4417-89df-788840e4e99d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:24.541158 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c35c0f28-2437-4417-89df-788840e4e99d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:24.547312 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c35c0f28-2437-4417-89df-788840e4e99d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:24.547757 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c35c0f28-2437-4417-89df-788840e4e99d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:24.548501 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c35c0f28-2437-4417-89df-788840e4e99d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:24.548915 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c35c0f28-2437-4417-89df-788840e4e99d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:24.694451 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c35c0f28-2437-4417-89df-788840e4e99d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:24.702783 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c35c0f28-2437-4417-89df-788840e4e99d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1680 microversion: 2.1 time: 0.166359 Jun 23 17:20:24.703347 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 426/866] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:24 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:25.721119 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c21d465b-fe50-4edc-a543-3fe2bdcb780d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:25.721832 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c21d465b-fe50-4edc-a543-3fe2bdcb780d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:25.728945 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c21d465b-fe50-4edc-a543-3fe2bdcb780d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:25.729392 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c21d465b-fe50-4edc-a543-3fe2bdcb780d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:25.730172 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c21d465b-fe50-4edc-a543-3fe2bdcb780d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:25.730596 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c21d465b-fe50-4edc-a543-3fe2bdcb780d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:25.866705 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c21d465b-fe50-4edc-a543-3fe2bdcb780d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:25.875048 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c21d465b-fe50-4edc-a543-3fe2bdcb780d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1680 microversion: 2.1 time: 0.158237 Jun 23 17:20:25.875625 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 441/867] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:25 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:26.892834 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4084b8c5-7fa2-44d5-8eed-0737a1324cc9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:26.893438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4084b8c5-7fa2-44d5-8eed-0737a1324cc9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:26.900171 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4084b8c5-7fa2-44d5-8eed-0737a1324cc9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:26.900662 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4084b8c5-7fa2-44d5-8eed-0737a1324cc9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:26.901426 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4084b8c5-7fa2-44d5-8eed-0737a1324cc9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:26.901884 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4084b8c5-7fa2-44d5-8eed-0737a1324cc9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:27.143941 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4084b8c5-7fa2-44d5-8eed-0737a1324cc9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:27.157959 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4084b8c5-7fa2-44d5-8eed-0737a1324cc9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1680 microversion: 2.1 time: 0.268866 Jun 23 17:20:27.158575 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 427/868] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:26 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1680 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:27.651714 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-35aaef41-aa1c-4d9b-83bf-6d27b2a907d0 req-27a74ac1-b177-4ee3-b49d-e20db22f8fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51605a4b-853e-479f-a3e6-f09880c23d5b", "name": "network-vif-deleted", "tag": "bd95943b-1970-4801-a4a2-b918b988ab45"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:27.662729 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-35aaef41-aa1c-4d9b-83bf-6d27b2a907d0 req-27a74ac1-b177-4ee3-b49d-e20db22f8fb3 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:27.663251 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-35aaef41-aa1c-4d9b-83bf-6d27b2a907d0 req-27a74ac1-b177-4ee3-b49d-e20db22f8fb3 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:27.675050 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-35aaef41-aa1c-4d9b-83bf-6d27b2a907d0 req-27a74ac1-b177-4ee3-b49d-e20db22f8fb3 service nova] Creating event network-vif-deleted:bd95943b-1970-4801-a4a2-b918b988ab45 for instance 51605a4b-853e-479f-a3e6-f09880c23d5b on hv-cinder-83538 Jun 23 17:20:27.681269 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-35aaef41-aa1c-4d9b-83bf-6d27b2a907d0 req-27a74ac1-b177-4ee3-b49d-e20db22f8fb3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034047 Jun 23 17:20:27.687126 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 442/869] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:20:28.175792 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4493e7ea-d36a-4bf6-ae18-5600985dfd89 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:28.176374 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4493e7ea-d36a-4bf6-ae18-5600985dfd89 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:28.184538 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4493e7ea-d36a-4bf6-ae18-5600985dfd89 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:28.184988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4493e7ea-d36a-4bf6-ae18-5600985dfd89 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:28.185758 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4493e7ea-d36a-4bf6-ae18-5600985dfd89 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:28.186251 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4493e7ea-d36a-4bf6-ae18-5600985dfd89 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:28.219826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4493e7ea-d36a-4bf6-ae18-5600985dfd89 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:28.220258 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4493e7ea-d36a-4bf6-ae18-5600985dfd89 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:28.220723 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-4493e7ea-d36a-4bf6-ae18-5600985dfd89 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lazy-loading 'fault' on Instance uuid 51605a4b-853e-479f-a3e6-f09880c23d5b {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:20:28.262080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4493e7ea-d36a-4bf6-ae18-5600985dfd89 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:28.269781 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4493e7ea-d36a-4bf6-ae18-5600985dfd89 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 200 len: 1331 microversion: 2.1 time: 0.097990 Jun 23 17:20:28.270356 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 428/870] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:28 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:29.292617 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-673a5c50-8edf-4ff2-8118-22a057caabe3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:29.293370 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-673a5c50-8edf-4ff2-8118-22a057caabe3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:29.300485 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-673a5c50-8edf-4ff2-8118-22a057caabe3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:29.300956 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-673a5c50-8edf-4ff2-8118-22a057caabe3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:29.301753 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-673a5c50-8edf-4ff2-8118-22a057caabe3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:29.302243 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-673a5c50-8edf-4ff2-8118-22a057caabe3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:29.317006 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-673a5c50-8edf-4ff2-8118-22a057caabe3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] HTTP exception thrown: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-673a5c50-8edf-4ff2-8118-22a057caabe3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Request method failure captured: Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b HTTP/1.1 Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7iwY6C5zaqNRYLxueUq43muN0MHe54Fc4Vi8vUs_FNvBOzPmyPl2Y8AX6pFx2OI3hqvDvcKTZrFu8kIfpY_ykWG-5HAqbUcRHhG3HFFYy7PKAmD1gcfEdkk0kUs8MeaKA3KSx5FzNY4j9As2Ih8lkR3_iOjjcRNTH7mXCIBr57mgM Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:20:29.318730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:20:29.320175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_201cf53eaff642e78cf394182b0b9972", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}] Jun 23 17:20:29.320175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:20:29.320175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:20:29.320175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:20:29.320175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:20:29.320175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:20:29.320175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:20:29.320175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: fc6a4d6c1f834720a69ee30d5ae63cc9 Jun 23 17:20:29.320175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:20:29.320175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:20:29.320175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:20:29.320175 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '51605a4b-853e-479f-a3e6-f09880c23d5b'} Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:20:29.321051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:20:29.323154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:29.324707 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-673a5c50-8edf-4ff2-8118-22a057caabe3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Returning 404 to user: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:20:29.324707 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-673a5c50-8edf-4ff2-8118-22a057caabe3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 404 len: 111 microversion: 2.1 time: 0.034605 Jun 23 17:20:29.324707 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 443/871] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:29 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:20:29.329393 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-15c0c745-4db4-497b-943e-01dedd62c491 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '.version_select at 0x7f34323e7790>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:29.349484 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-15c0c745-4db4-497b-943e-01dedd62c491 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-333792519" status: 202 len: 0 microversion: 2.1 time: 0.023864 Jun 23 17:20:29.350102 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 429/872] 10.222.0.18 () {58 vars in 1217 bytes} [Thu Jun 23 17:20:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-333792519 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 17:20:30.256931 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a36552d6-1a8e-4e8c-b36f-c6794debb343 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Action: 'create', calling method: .version_select at 0x7f342db078b0>, body: {"keypair": {"name": "tempest-keypair-1132401785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcK90KA+4eLbmYmJxqdmOQdpZZKq4K5kMwP4LGuBjziLWxcl4/FATP41VlfJcBS97TOpkZOLgVVOzj3NAbRB6IrYPCsw1ugrqRCuXza3my2dUf1FXtoQ0W9zA5VVaTwWg=="}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:30.271180 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-a36552d6-1a8e-4e8c-b36f-c6794debb343 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for project 201cf53eaff642e78cf394182b0b9972. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:20:30.274997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-a36552d6-1a8e-4e8c-b36f-c6794debb343 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for user fc6a4d6c1f834720a69ee30d5ae63cc9 and project 201cf53eaff642e78cf394182b0b9972. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:20:30.298815 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a36552d6-1a8e-4e8c-b36f-c6794debb343 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045818 Jun 23 17:20:30.299518 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 444/873] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 23 17:20:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:20:31.890271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-43000470", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3cd0a13-7d3d-4379-9bdb-f7a035d3d8b1"}], "security_groups": [{"name": "tempest-securitygroup--1492967150"}], "key_name": "tempest-keypair-1132401785", "user_data": "}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:31.993705 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] validate_networks() for [('a3cd0a13-7d3d-4379-9bdb-f7a035d3d8b1', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:20:32.381453 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:20:32.381908 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:20:32.382374 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:20:32.382800 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:20:32.383236 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:20:32.398982 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:32.399424 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:32.400401 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:32.400848 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:32.417843 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for project 201cf53eaff642e78cf394182b0b9972. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:20:32.421979 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Getting quotas for user fc6a4d6c1f834720a69ee30d5ae63cc9 and project 201cf53eaff642e78cf394182b0b9972. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:20:32.433707 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:20:32.436033 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:20:32.484488 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b1e2449f-2f8a-4ad4-9774-0ac016df70c1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.599072 Jun 23 17:20:32.485152 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 430/874] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:20:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 17:20:32.495748 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-03af46bb-2bec-4b61-8be3-2aedd0edf433 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:32.496348 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-03af46bb-2bec-4b61-8be3-2aedd0edf433 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:32.550633 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-03af46bb-2bec-4b61-8be3-2aedd0edf433 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:32.558206 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-03af46bb-2bec-4b61-8be3-2aedd0edf433 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1240 microversion: 2.1 time: 0.066946 Jun 23 17:20:32.559340 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 445/875] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:32 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:33.576452 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9ff3d99c-5505-4b58-b621-dd099d7e9d3c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:33.577656 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9ff3d99c-5505-4b58-b621-dd099d7e9d3c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:33.584398 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ff3d99c-5505-4b58-b621-dd099d7e9d3c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:33.584831 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ff3d99c-5505-4b58-b621-dd099d7e9d3c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:33.585761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ff3d99c-5505-4b58-b621-dd099d7e9d3c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:33.586234 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ff3d99c-5505-4b58-b621-dd099d7e9d3c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:33.665125 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9ff3d99c-5505-4b58-b621-dd099d7e9d3c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:33.674242 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9ff3d99c-5505-4b58-b621-dd099d7e9d3c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1300 microversion: 2.1 time: 0.102290 Jun 23 17:20:33.675155 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 431/876] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:33 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:34.692200 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-45f92412-5788-4ab6-bfc6-c445a709c7a0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:34.693549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-45f92412-5788-4ab6-bfc6-c445a709c7a0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:34.700538 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-45f92412-5788-4ab6-bfc6-c445a709c7a0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:34.701058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-45f92412-5788-4ab6-bfc6-c445a709c7a0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:34.702064 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-45f92412-5788-4ab6-bfc6-c445a709c7a0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:34.702492 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-45f92412-5788-4ab6-bfc6-c445a709c7a0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:34.833781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-45f92412-5788-4ab6-bfc6-c445a709c7a0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:34.841563 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-45f92412-5788-4ab6-bfc6-c445a709c7a0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1366 microversion: 2.1 time: 0.153462 Jun 23 17:20:34.842177 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 446/877] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:34 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:35.089964 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-d6bb0c8b-3f39-45bb-8ed2-8c7a1cc2a578 req-74d0d655-e541-47a5-bac3-5bb7fec01691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bee73e46-ae4e-47fe-908c-9c5c6ace3538", "tag": "54a11b14-2779-4d3f-a5d5-48f66702f69f"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:35.098918 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d6bb0c8b-3f39-45bb-8ed2-8c7a1cc2a578 req-74d0d655-e541-47a5-bac3-5bb7fec01691 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:35.099352 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d6bb0c8b-3f39-45bb-8ed2-8c7a1cc2a578 req-74d0d655-e541-47a5-bac3-5bb7fec01691 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:35.104960 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:35.114464 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-d6bb0c8b-3f39-45bb-8ed2-8c7a1cc2a578 req-74d0d655-e541-47a5-bac3-5bb7fec01691 service nova] Creating event network-changed:54a11b14-2779-4d3f-a5d5-48f66702f69f for instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 on hv-cinder-83538 Jun 23 17:20:35.120197 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-d6bb0c8b-3f39-45bb-8ed2-8c7a1cc2a578 req-74d0d655-e541-47a5-bac3-5bb7fec01691 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034094 Jun 23 17:20:35.120819 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 432/878] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:20:35.858689 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-56dc9543-4922-4f4a-b0a2-08ce917735a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:35.859284 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-56dc9543-4922-4f4a-b0a2-08ce917735a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:35.866318 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-56dc9543-4922-4f4a-b0a2-08ce917735a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:35.866758 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-56dc9543-4922-4f4a-b0a2-08ce917735a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:35.867549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-56dc9543-4922-4f4a-b0a2-08ce917735a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:35.867970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-56dc9543-4922-4f4a-b0a2-08ce917735a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:35.999730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-56dc9543-4922-4f4a-b0a2-08ce917735a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:36.007809 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-56dc9543-4922-4f4a-b0a2-08ce917735a2 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1366 microversion: 2.1 time: 0.153256 Jun 23 17:20:36.008376 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 447/879] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:35 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:37.029538 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c1fc73d5-c804-4fb5-ac48-6fd3001760b3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:37.030263 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c1fc73d5-c804-4fb5-ac48-6fd3001760b3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:37.032199 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:37.038038 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c1fc73d5-c804-4fb5-ac48-6fd3001760b3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:37.038486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c1fc73d5-c804-4fb5-ac48-6fd3001760b3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:37.039262 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c1fc73d5-c804-4fb5-ac48-6fd3001760b3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:37.039690 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c1fc73d5-c804-4fb5-ac48-6fd3001760b3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:37.173325 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c1fc73d5-c804-4fb5-ac48-6fd3001760b3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:37.185542 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c1fc73d5-c804-4fb5-ac48-6fd3001760b3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1366 microversion: 2.1 time: 0.162575 Jun 23 17:20:37.186307 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 433/880] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:37 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:38.206805 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-be5b22f1-5843-4d44-b583-02f37051b706 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:38.207683 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-be5b22f1-5843-4d44-b583-02f37051b706 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:38.218904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-be5b22f1-5843-4d44-b583-02f37051b706 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:38.219640 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-be5b22f1-5843-4d44-b583-02f37051b706 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:38.220893 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-be5b22f1-5843-4d44-b583-02f37051b706 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:38.221612 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-be5b22f1-5843-4d44-b583-02f37051b706 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:38.226043 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:38.361948 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-be5b22f1-5843-4d44-b583-02f37051b706 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:38.374382 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-be5b22f1-5843-4d44-b583-02f37051b706 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1366 microversion: 2.1 time: 0.174020 Jun 23 17:20:38.375151 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 448/881] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:38 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:39.395252 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-272c10d2-7354-4036-8cb9-2a36e126a7df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:39.396285 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-272c10d2-7354-4036-8cb9-2a36e126a7df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:39.405434 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-272c10d2-7354-4036-8cb9-2a36e126a7df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:39.405904 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-272c10d2-7354-4036-8cb9-2a36e126a7df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:39.406661 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-272c10d2-7354-4036-8cb9-2a36e126a7df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:39.407089 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-272c10d2-7354-4036-8cb9-2a36e126a7df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:39.535773 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-272c10d2-7354-4036-8cb9-2a36e126a7df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:39.544116 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-272c10d2-7354-4036-8cb9-2a36e126a7df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1366 microversion: 2.1 time: 0.155459 Jun 23 17:20:39.544777 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 434/882] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:39 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:40.562595 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-df8941ef-ef79-4cc8-ae27-987aed25e342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:40.563357 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-df8941ef-ef79-4cc8-ae27-987aed25e342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:40.571399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-df8941ef-ef79-4cc8-ae27-987aed25e342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:40.571996 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-df8941ef-ef79-4cc8-ae27-987aed25e342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:40.572932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-df8941ef-ef79-4cc8-ae27-987aed25e342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:40.573468 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-df8941ef-ef79-4cc8-ae27-987aed25e342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:40.709902 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-df8941ef-ef79-4cc8-ae27-987aed25e342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:40.717490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-df8941ef-ef79-4cc8-ae27-987aed25e342 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1366 microversion: 2.1 time: 0.160112 Jun 23 17:20:40.718072 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 449/883] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:40 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:41.697682 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-af9d39df-289d-40f6-8dfa-683b47e00e67 req-c2a593f9-5299-40e3-99c5-fda2b5d4d4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee73e46-ae4e-47fe-908c-9c5c6ace3538", "name": "network-vif-plugged", "status": "completed", "tag": "54a11b14-2779-4d3f-a5d5-48f66702f69f"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:41.708665 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-af9d39df-289d-40f6-8dfa-683b47e00e67 req-c2a593f9-5299-40e3-99c5-fda2b5d4d4a8 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:41.709182 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-af9d39df-289d-40f6-8dfa-683b47e00e67 req-c2a593f9-5299-40e3-99c5-fda2b5d4d4a8 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:41.722113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-af9d39df-289d-40f6-8dfa-683b47e00e67 req-c2a593f9-5299-40e3-99c5-fda2b5d4d4a8 service nova] Creating event network-vif-plugged:54a11b14-2779-4d3f-a5d5-48f66702f69f for instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 on hv-cinder-83538 Jun 23 17:20:41.727424 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-af9d39df-289d-40f6-8dfa-683b47e00e67 req-c2a593f9-5299-40e3-99c5-fda2b5d4d4a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037764 Jun 23 17:20:41.728480 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 435/884] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:20:41.737052 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7f450b1f-331d-475f-8ee6-cc7b2e6291ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:41.737052 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7f450b1f-331d-475f-8ee6-cc7b2e6291ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:41.743538 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7f450b1f-331d-475f-8ee6-cc7b2e6291ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:41.744193 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7f450b1f-331d-475f-8ee6-cc7b2e6291ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:41.744948 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7f450b1f-331d-475f-8ee6-cc7b2e6291ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:41.745373 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7f450b1f-331d-475f-8ee6-cc7b2e6291ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:41.875076 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7f450b1f-331d-475f-8ee6-cc7b2e6291ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:41.882791 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7f450b1f-331d-475f-8ee6-cc7b2e6291ee tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1366 microversion: 2.1 time: 0.152383 Jun 23 17:20:41.883356 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 450/885] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:41 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:42.898573 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:42.899343 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:42.905412 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-40fab4eb-c558-4d6d-837e-06905bb2a6ec tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:42.906222 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-40fab4eb-c558-4d6d-837e-06905bb2a6ec tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:42.913423 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-40fab4eb-c558-4d6d-837e-06905bb2a6ec tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:42.913907 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-40fab4eb-c558-4d6d-837e-06905bb2a6ec tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:42.914649 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-40fab4eb-c558-4d6d-837e-06905bb2a6ec tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:42.915079 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-40fab4eb-c558-4d6d-837e-06905bb2a6ec tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:43.051720 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-40fab4eb-c558-4d6d-837e-06905bb2a6ec tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:43.060131 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-40fab4eb-c558-4d6d-837e-06905bb2a6ec tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1366 microversion: 2.1 time: 0.162789 Jun 23 17:20:43.060671 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 436/886] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:42 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:44.079080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a5ad2084-bd21-43d5-a681-6e51feb6d5df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:44.079747 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a5ad2084-bd21-43d5-a681-6e51feb6d5df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:44.081582 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=6 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:44.082694 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:44.088499 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a5ad2084-bd21-43d5-a681-6e51feb6d5df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:44.088945 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a5ad2084-bd21-43d5-a681-6e51feb6d5df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:44.089705 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a5ad2084-bd21-43d5-a681-6e51feb6d5df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:44.090165 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a5ad2084-bd21-43d5-a681-6e51feb6d5df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:44.222144 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a5ad2084-bd21-43d5-a681-6e51feb6d5df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:44.230139 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a5ad2084-bd21-43d5-a681-6e51feb6d5df tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1556 microversion: 2.1 time: 0.156318 Jun 23 17:20:44.230806 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 451/887] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:44 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:44.246579 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a1e30f6c-a49d-4c20-b651-c0fc60d40f55 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:44.247141 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a1e30f6c-a49d-4c20-b651-c0fc60d40f55 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:44.253948 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a1e30f6c-a49d-4c20-b651-c0fc60d40f55 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:44.254390 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a1e30f6c-a49d-4c20-b651-c0fc60d40f55 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:44.255144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a1e30f6c-a49d-4c20-b651-c0fc60d40f55 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:44.255573 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a1e30f6c-a49d-4c20-b651-c0fc60d40f55 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:44.338913 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a1e30f6c-a49d-4c20-b651-c0fc60d40f55 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096214 Jun 23 17:20:44.339519 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 437/888] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 23 17:20:44 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:20:45.275142 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-b1099355-03dc-4411-a07c-2fab642fabb1 req-064d4c56-f00b-449b-aa19-1110f2c66230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bee73e46-ae4e-47fe-908c-9c5c6ace3538", "tag": "54a11b14-2779-4d3f-a5d5-48f66702f69f"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:45.285666 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-b1099355-03dc-4411-a07c-2fab642fabb1 req-064d4c56-f00b-449b-aa19-1110f2c66230 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:45.286489 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-b1099355-03dc-4411-a07c-2fab642fabb1 req-064d4c56-f00b-449b-aa19-1110f2c66230 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:45.301469 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-b1099355-03dc-4411-a07c-2fab642fabb1 req-064d4c56-f00b-449b-aa19-1110f2c66230 service nova] Creating event network-changed:54a11b14-2779-4d3f-a5d5-48f66702f69f for instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 on hv-cinder-83538 Jun 23 17:20:45.307663 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-b1099355-03dc-4411-a07c-2fab642fabb1 req-064d4c56-f00b-449b-aa19-1110f2c66230 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036859 Jun 23 17:20:45.308369 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 452/889] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:20:46.785595 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-49042673-defa-4bbb-98cf-25ea23ec5d25 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:46.786275 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-49042673-defa-4bbb-98cf-25ea23ec5d25 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:46.788121 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-ee742f38-d5e0-495e-ac46-ed37b217a8c0 req-e38de8d0-2697-477c-8427-2550d326d33a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eed0594-b0c2-4c93-a04b-898a6e02ca06", "tag": "0ea26bf7-a55b-43ac-9717-c694d5cc21f4"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:46.793206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49042673-defa-4bbb-98cf-25ea23ec5d25 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:46.793642 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49042673-defa-4bbb-98cf-25ea23ec5d25 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:46.794438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49042673-defa-4bbb-98cf-25ea23ec5d25 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:46.794867 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49042673-defa-4bbb-98cf-25ea23ec5d25 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:46.796706 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-ee742f38-d5e0-495e-ac46-ed37b217a8c0 req-e38de8d0-2697-477c-8427-2550d326d33a service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:46.797496 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-ee742f38-d5e0-495e-ac46-ed37b217a8c0 req-e38de8d0-2697-477c-8427-2550d326d33a service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:46.809503 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-ee742f38-d5e0-495e-ac46-ed37b217a8c0 req-e38de8d0-2697-477c-8427-2550d326d33a service nova] Creating event network-changed:0ea26bf7-a55b-43ac-9717-c694d5cc21f4 for instance 4eed0594-b0c2-4c93-a04b-898a6e02ca06 on hv-cinder-83538 Jun 23 17:20:46.814820 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-ee742f38-d5e0-495e-ac46-ed37b217a8c0 req-e38de8d0-2697-477c-8427-2550d326d33a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031146 Jun 23 17:20:46.815409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 453/890] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:20:46.824204 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-49042673-defa-4bbb-98cf-25ea23ec5d25 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:20:46.916032 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-49042673-defa-4bbb-98cf-25ea23ec5d25 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 204 len: 0 microversion: 2.1 time: 0.134738 Jun 23 17:20:46.916965 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 438/891] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:20:46 2022] DELETE /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:20:46.926153 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6334153e-3203-4285-961a-d9a2d34be2cf tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:46.927236 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6334153e-3203-4285-961a-d9a2d34be2cf tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:46.934174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6334153e-3203-4285-961a-d9a2d34be2cf tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:46.934897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6334153e-3203-4285-961a-d9a2d34be2cf tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:46.936147 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6334153e-3203-4285-961a-d9a2d34be2cf tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:46.937133 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6334153e-3203-4285-961a-d9a2d34be2cf tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:47.085625 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6334153e-3203-4285-961a-d9a2d34be2cf tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:47.093588 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6334153e-3203-4285-961a-d9a2d34be2cf tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1568 microversion: 2.1 time: 0.172152 Jun 23 17:20:47.094330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 454/892] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:46 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:48.117345 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fc012590-6971-49c4-aac1-0f864f9a05ee tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:48.118063 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fc012590-6971-49c4-aac1-0f864f9a05ee tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:48.125006 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fc012590-6971-49c4-aac1-0f864f9a05ee tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:48.125452 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fc012590-6971-49c4-aac1-0f864f9a05ee tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:48.126317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fc012590-6971-49c4-aac1-0f864f9a05ee tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:48.126750 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fc012590-6971-49c4-aac1-0f864f9a05ee tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:48.292211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fc012590-6971-49c4-aac1-0f864f9a05ee tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:48.300213 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fc012590-6971-49c4-aac1-0f864f9a05ee tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1568 microversion: 2.1 time: 0.189101 Jun 23 17:20:48.300793 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 439/893] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:48 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:49.275489 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-995027a8-5165-4a7c-ae94-8238c5d0bc2e req-b829b9ca-922c-48b3-9616-6594986eb66c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eed0594-b0c2-4c93-a04b-898a6e02ca06", "name": "network-vif-deleted", "tag": "0ea26bf7-a55b-43ac-9717-c694d5cc21f4"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:20:49.286341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-995027a8-5165-4a7c-ae94-8238c5d0bc2e req-b829b9ca-922c-48b3-9616-6594986eb66c service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:49.286787 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-995027a8-5165-4a7c-ae94-8238c5d0bc2e req-b829b9ca-922c-48b3-9616-6594986eb66c service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:49.300383 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-995027a8-5165-4a7c-ae94-8238c5d0bc2e req-b829b9ca-922c-48b3-9616-6594986eb66c service nova] Creating event network-vif-deleted:0ea26bf7-a55b-43ac-9717-c694d5cc21f4 for instance 4eed0594-b0c2-4c93-a04b-898a6e02ca06 on hv-cinder-83538 Jun 23 17:20:49.305473 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-995027a8-5165-4a7c-ae94-8238c5d0bc2e req-b829b9ca-922c-48b3-9616-6594986eb66c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035548 Jun 23 17:20:49.306124 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 455/894] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:20:49.318789 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-084734d5-a1b8-462f-8148-1865a077e002 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:49.319422 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-084734d5-a1b8-462f-8148-1865a077e002 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:49.325655 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-084734d5-a1b8-462f-8148-1865a077e002 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:49.326123 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-084734d5-a1b8-462f-8148-1865a077e002 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:49.327124 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-084734d5-a1b8-462f-8148-1865a077e002 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:49.327557 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-084734d5-a1b8-462f-8148-1865a077e002 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:49.389909 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-084734d5-a1b8-462f-8148-1865a077e002 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1e3a5739ac4a46beb0baa8887660f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e456e86229d84ae28c56cf25357f99bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:20:49.398435 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-084734d5-a1b8-462f-8148-1865a077e002 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 200 len: 1220 microversion: 2.1 time: 0.084045 Jun 23 17:20:49.398994 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 440/895] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:49 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:20:50.422569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3a6aef53-48f3-4925-a9fa-7dc5f9d1f66d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:50.423578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3a6aef53-48f3-4925-a9fa-7dc5f9d1f66d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] [instance: 4eed0594-b0c2-4c93-a04b-898a6e02ca06] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:20:50.434661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a6aef53-48f3-4925-a9fa-7dc5f9d1f66d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:50.435397 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a6aef53-48f3-4925-a9fa-7dc5f9d1f66d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:50.436647 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a6aef53-48f3-4925-a9fa-7dc5f9d1f66d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:20:50.437363 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a6aef53-48f3-4925-a9fa-7dc5f9d1f66d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:20:50.451321 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-3a6aef53-48f3-4925-a9fa-7dc5f9d1f66d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] HTTP exception thrown: Instance 4eed0594-b0c2-4c93-a04b-898a6e02ca06 could not be found. Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3a6aef53-48f3-4925-a9fa-7dc5f9d1f66d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Request method failure captured: Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 HTTP/1.1 Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ9kYLADKKKdcEt0Kt012fg0Kk6nYmsO0BRE5MSLAZQuzl8KmyB2GjVYY9hQ4LvQVGaFuI8pHs2baIMAAjVp45x0iBUZ90Io5yD_AS4BrpOfkohI4iPltxqZFNBwyNpVWz-4dghpRBVmkPMD7Pir8boriE5-VGxIjfTWbISlYYrlh10 Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: e456e86229d84ae28c56cf25357f99bc Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-TestShelveInstance-1754450139 Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:20:50.453058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:20:50.454695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e456e86229d84ae28c56cf25357f99bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e456e86229d84ae28c56cf25357f99bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e456e86229d84ae28c56cf25357f99bc", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e456e86229d84ae28c56cf25357f99bc"}]}] Jun 23 17:20:50.454695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-TestShelveInstance-1754450139 Jun 23 17:20:50.454695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: e456e86229d84ae28c56cf25357f99bc Jun 23 17:20:50.454695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-TestShelveInstance-1754450139 Jun 23 17:20:50.454695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-TestShelveInstance-1754450139-project Jun 23 17:20:50.454695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:20:50.454695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:20:50.454695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 9a1e3a5739ac4a46beb0baa8887660f5 Jun 23 17:20:50.454695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-TestShelveInstance-1754450139-project Jun 23 17:20:50.454695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:20:50.454695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance 4eed0594-b0c2-4c93-a04b-898a6e02ca06 could not be found. Jun 23 17:20:50.454695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '4eed0594-b0c2-4c93-a04b-898a6e02ca06'} Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eed0594-b0c2-4c93-a04b-898a6e02ca06 could not be found. Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:20:50.455543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eed0594-b0c2-4c93-a04b-898a6e02ca06 could not be found. Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eed0594-b0c2-4c93-a04b-898a6e02ca06 could not be found. Jun 23 17:20:50.456845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:20:50.458072 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3a6aef53-48f3-4925-a9fa-7dc5f9d1f66d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Returning 404 to user: Instance 4eed0594-b0c2-4c93-a04b-898a6e02ca06 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:20:50.458072 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3a6aef53-48f3-4925-a9fa-7dc5f9d1f66d tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06" status: 404 len: 111 microversion: 2.1 time: 0.039824 Jun 23 17:20:50.458072 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 456/896] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:20:50 2022] GET /compute/v2.1/servers/4eed0594-b0c2-4c93-a04b-898a6e02ca06 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:20:50.625730 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-30e4829f-8240-4d8a-b3d4-7ee11116c533 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] Calling method '.version_select at 0x7f343238c430>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:20:50.644920 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-30e4829f-8240-4d8a-b3d4-7ee11116c533 tempest-TestShelveInstance-1754450139 tempest-TestShelveInstance-1754450139-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1616861067" status: 202 len: 0 microversion: 2.1 time: 0.023273 Jun 23 17:20:50.646045 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 441/897] 10.222.0.18 () {58 vars in 1253 bytes} [Thu Jun 23 17:20:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1616861067 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:21:36.492154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5cf3bbcd-7f86-4b89-8ef4-f4ccf04354d0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:36.493144 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5cf3bbcd-7f86-4b89-8ef4-f4ccf04354d0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:36.496328 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=11 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:21:36.497359 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=37 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:21:36.507382 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5cf3bbcd-7f86-4b89-8ef4-f4ccf04354d0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:36.508104 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5cf3bbcd-7f86-4b89-8ef4-f4ccf04354d0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:36.509359 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5cf3bbcd-7f86-4b89-8ef4-f4ccf04354d0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:36.510129 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5cf3bbcd-7f86-4b89-8ef4-f4ccf04354d0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:36.537842 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5cf3bbcd-7f86-4b89-8ef4-f4ccf04354d0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/ips" status: 200 len: 152 microversion: 2.20 time: 0.053930 Jun 23 17:21:36.538422 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 457/898] 10.222.0.18 () {60 vars in 1288 bytes} [Thu Jun 23 17:21:36 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/ips => generated 152 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:21:40.461024 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:21:40.461823 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:21:40.468460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e3644759-e572-47e3-bd1e-521052ad2c49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:21:40.469275 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e3644759-e572-47e3-bd1e-521052ad2c49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:40.477934 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e3644759-e572-47e3-bd1e-521052ad2c49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:40.478374 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e3644759-e572-47e3-bd1e-521052ad2c49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:40.479138 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e3644759-e572-47e3-bd1e-521052ad2c49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:40.479570 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e3644759-e572-47e3-bd1e-521052ad2c49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:40.503836 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-e3644759-e572-47e3-bd1e-521052ad2c49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lazy-loading 'flavor' on Instance uuid 65320df8-ae02-4a62-bde7-14088815afcb {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:21:40.787779 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e3644759-e572-47e3-bd1e-521052ad2c49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "POST /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/action" status: 202 len: 0 microversion: 2.20 time: 0.329360 Jun 23 17:21:40.788485 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 442/899] 10.222.0.18 () {62 vars in 1318 bytes} [Thu Jun 23 17:21:40 2022] POST /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 23 17:21:40.798633 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e818454f-d1ac-4a8e-b79e-c31fa0145a6f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:40.799194 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e818454f-d1ac-4a8e-b79e-c31fa0145a6f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:40.805753 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e818454f-d1ac-4a8e-b79e-c31fa0145a6f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:40.806333 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e818454f-d1ac-4a8e-b79e-c31fa0145a6f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:40.807111 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e818454f-d1ac-4a8e-b79e-c31fa0145a6f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:40.807607 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e818454f-d1ac-4a8e-b79e-c31fa0145a6f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:40.947593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e818454f-d1ac-4a8e-b79e-c31fa0145a6f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:40.955885 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e818454f-d1ac-4a8e-b79e-c31fa0145a6f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:40.958148 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e818454f-d1ac-4a8e-b79e-c31fa0145a6f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:40.959354 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e818454f-d1ac-4a8e-b79e-c31fa0145a6f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1723 microversion: 2.20 time: 0.165299 Jun 23 17:21:40.959911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 458/900] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:40 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:41.990380 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b454a3a0-144a-4a73-a89a-add02fd5dc63 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:41.991208 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b454a3a0-144a-4a73-a89a-add02fd5dc63 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:42.002002 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b454a3a0-144a-4a73-a89a-add02fd5dc63 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:42.002465 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b454a3a0-144a-4a73-a89a-add02fd5dc63 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:42.003388 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b454a3a0-144a-4a73-a89a-add02fd5dc63 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:42.003848 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b454a3a0-144a-4a73-a89a-add02fd5dc63 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:42.155257 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b454a3a0-144a-4a73-a89a-add02fd5dc63 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:42.164066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b454a3a0-144a-4a73-a89a-add02fd5dc63 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:42.165556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b454a3a0-144a-4a73-a89a-add02fd5dc63 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:42.166743 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b454a3a0-144a-4a73-a89a-add02fd5dc63 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1723 microversion: 2.20 time: 0.184450 Jun 23 17:21:42.167273 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 443/901] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:41 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:43.192184 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ed3f93bb-a4c0-4a54-899d-52537d3f4e5e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:43.192792 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ed3f93bb-a4c0-4a54-899d-52537d3f4e5e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:43.200318 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ed3f93bb-a4c0-4a54-899d-52537d3f4e5e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:43.200851 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ed3f93bb-a4c0-4a54-899d-52537d3f4e5e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:43.201609 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ed3f93bb-a4c0-4a54-899d-52537d3f4e5e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:43.202068 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ed3f93bb-a4c0-4a54-899d-52537d3f4e5e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:43.335430 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ed3f93bb-a4c0-4a54-899d-52537d3f4e5e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:43.347826 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ed3f93bb-a4c0-4a54-899d-52537d3f4e5e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:43.350190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ed3f93bb-a4c0-4a54-899d-52537d3f4e5e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:43.352435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ed3f93bb-a4c0-4a54-899d-52537d3f4e5e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1723 microversion: 2.20 time: 0.163626 Jun 23 17:21:43.353248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 459/902] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:43 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:44.373342 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-346280828", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1835957938", "security_groups": [{"name": "tempest-secgroup-smoke-1613163096"}], "block_device_mapping_v2": [{"uuid": "1a005389-b46c-42df-918e-bd5fe6ae268a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e627980-fd3e-406b-86cf-dac9a328ca6c"}]}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:21:44.375134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-20c2c977-16ab-44c5-b748-79677710d45c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:44.375712 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-20c2c977-16ab-44c5-b748-79677710d45c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:44.382573 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-20c2c977-16ab-44c5-b748-79677710d45c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:44.383022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-20c2c977-16ab-44c5-b748-79677710d45c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:44.383874 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-20c2c977-16ab-44c5-b748-79677710d45c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:44.384321 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-20c2c977-16ab-44c5-b748-79677710d45c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:44.487461 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] validate_networks() for [('7e627980-fd3e-406b-86cf-dac9a328ca6c', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:21:44.523870 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-20c2c977-16ab-44c5-b748-79677710d45c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:44.532238 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-20c2c977-16ab-44c5-b748-79677710d45c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:44.534074 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-20c2c977-16ab-44c5-b748-79677710d45c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:44.535244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-20c2c977-16ab-44c5-b748-79677710d45c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1723 microversion: 2.20 time: 0.164006 Jun 23 17:21:44.535784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 460/903] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:44 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:44.895864 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:21:44.896282 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:21:44.896745 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:21:44.897140 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:21:44.897543 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:21:44.907176 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:44.907802 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:44.908672 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:44.909085 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:44.928445 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Getting quotas for project e393091e3c2d42e79e9f2ec80d471faf. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:21:44.932852 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Getting quotas for user d21524f4232648ebaed76e1d7d5daf5f and project e393091e3c2d42e79e9f2ec80d471faf. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:21:44.992311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:21:44.994457 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a005389-b46c-42df-918e-bd5fe6ae268a',volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:21:45.153274 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-19836001-2820-4ffc-aa26-534239d814be tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783623 Jun 23 17:21:45.154140 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 444/904] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:21:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:21:45.164410 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-aec0ac79-16a6-4ebc-8063-efde0fb4f47d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:45.165020 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-aec0ac79-16a6-4ebc-8063-efde0fb4f47d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:45.218389 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-aec0ac79-16a6-4ebc-8063-efde0fb4f47d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:45.226336 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-aec0ac79-16a6-4ebc-8063-efde0fb4f47d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1094 microversion: 2.1 time: 0.065712 Jun 23 17:21:45.227240 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 461/905] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:21:45 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:21:45.555129 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ab2c25dc-2d8d-4a2b-8c49-f0bc031a0e24 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:45.555725 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ab2c25dc-2d8d-4a2b-8c49-f0bc031a0e24 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:45.562525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ab2c25dc-2d8d-4a2b-8c49-f0bc031a0e24 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:45.563043 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ab2c25dc-2d8d-4a2b-8c49-f0bc031a0e24 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:45.564792 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ab2c25dc-2d8d-4a2b-8c49-f0bc031a0e24 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:45.564986 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ab2c25dc-2d8d-4a2b-8c49-f0bc031a0e24 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:45.713561 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ab2c25dc-2d8d-4a2b-8c49-f0bc031a0e24 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:45.722140 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ab2c25dc-2d8d-4a2b-8c49-f0bc031a0e24 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:45.723637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ab2c25dc-2d8d-4a2b-8c49-f0bc031a0e24 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:45.724788 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ab2c25dc-2d8d-4a2b-8c49-f0bc031a0e24 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1723 microversion: 2.20 time: 0.174588 Jun 23 17:21:45.725350 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 445/906] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:45 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:46.243643 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-50085780-f3a4-4f9c-8b93-bcfa128c1e7f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:46.244247 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-50085780-f3a4-4f9c-8b93-bcfa128c1e7f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:46.255449 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-50085780-f3a4-4f9c-8b93-bcfa128c1e7f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:46.256338 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-50085780-f3a4-4f9c-8b93-bcfa128c1e7f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:46.257122 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-50085780-f3a4-4f9c-8b93-bcfa128c1e7f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:46.257592 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-50085780-f3a4-4f9c-8b93-bcfa128c1e7f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:46.322934 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-50085780-f3a4-4f9c-8b93-bcfa128c1e7f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:46.331243 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-50085780-f3a4-4f9c-8b93-bcfa128c1e7f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1200 microversion: 2.1 time: 0.091482 Jun 23 17:21:46.331905 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 462/907] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:21:46 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:21:46.743423 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-67e4f8c1-0228-482a-be12-80c6846cea1d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:46.744004 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-67e4f8c1-0228-482a-be12-80c6846cea1d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:46.750918 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67e4f8c1-0228-482a-be12-80c6846cea1d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:46.751364 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67e4f8c1-0228-482a-be12-80c6846cea1d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:46.752160 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67e4f8c1-0228-482a-be12-80c6846cea1d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:46.752921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67e4f8c1-0228-482a-be12-80c6846cea1d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:46.972690 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-67e4f8c1-0228-482a-be12-80c6846cea1d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:46.980854 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-67e4f8c1-0228-482a-be12-80c6846cea1d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:46.982701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-67e4f8c1-0228-482a-be12-80c6846cea1d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:46.984253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-67e4f8c1-0228-482a-be12-80c6846cea1d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1723 microversion: 2.20 time: 0.244970 Jun 23 17:21:46.984879 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 446/908] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:46 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:47.349177 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-418ba938-8146-4cec-a1d0-6d2373aa0a0d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:47.350039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-418ba938-8146-4cec-a1d0-6d2373aa0a0d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:47.356931 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-418ba938-8146-4cec-a1d0-6d2373aa0a0d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:47.357372 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-418ba938-8146-4cec-a1d0-6d2373aa0a0d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:47.358158 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-418ba938-8146-4cec-a1d0-6d2373aa0a0d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:47.358585 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-418ba938-8146-4cec-a1d0-6d2373aa0a0d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:47.497107 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-418ba938-8146-4cec-a1d0-6d2373aa0a0d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:47.505762 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-418ba938-8146-4cec-a1d0-6d2373aa0a0d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1266 microversion: 2.1 time: 0.160927 Jun 23 17:21:47.506618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 463/909] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:21:47 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:21:47.825155 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-23bdb0cf-bce4-4984-9a12-0dc33a7ae4af req-c4f60cfc-f22d-4793-a4d8-431327170c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f24bd8-8c9f-442b-9c7b-41072c3a09fe", "tag": "17209ab7-6d94-4aed-96b3-e29955c001aa"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:21:47.838803 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-23bdb0cf-bce4-4984-9a12-0dc33a7ae4af req-c4f60cfc-f22d-4793-a4d8-431327170c42 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:47.839274 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-23bdb0cf-bce4-4984-9a12-0dc33a7ae4af req-c4f60cfc-f22d-4793-a4d8-431327170c42 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:47.853474 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-23bdb0cf-bce4-4984-9a12-0dc33a7ae4af req-c4f60cfc-f22d-4793-a4d8-431327170c42 service nova] Creating event network-changed:17209ab7-6d94-4aed-96b3-e29955c001aa for instance 11f24bd8-8c9f-442b-9c7b-41072c3a09fe on hv-cinder-83538 Jun 23 17:21:47.866360 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-23bdb0cf-bce4-4984-9a12-0dc33a7ae4af req-c4f60cfc-f22d-4793-a4d8-431327170c42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037393 Jun 23 17:21:47.867127 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 447/910] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:21:48.004006 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-385ceaf1-3c8b-49a6-9581-923bc1b1f17c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:48.004615 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-385ceaf1-3c8b-49a6-9581-923bc1b1f17c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:48.010797 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-385ceaf1-3c8b-49a6-9581-923bc1b1f17c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:48.011246 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-385ceaf1-3c8b-49a6-9581-923bc1b1f17c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:48.012010 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-385ceaf1-3c8b-49a6-9581-923bc1b1f17c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:48.012446 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-385ceaf1-3c8b-49a6-9581-923bc1b1f17c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:48.148744 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-385ceaf1-3c8b-49a6-9581-923bc1b1f17c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:48.159932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-385ceaf1-3c8b-49a6-9581-923bc1b1f17c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:48.162916 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-385ceaf1-3c8b-49a6-9581-923bc1b1f17c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:48.164819 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-385ceaf1-3c8b-49a6-9581-923bc1b1f17c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1723 microversion: 2.20 time: 0.165502 Jun 23 17:21:48.165396 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 464/911] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:47 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:48.525632 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9020b6c1-b9ce-4a58-96d4-1590c592b43f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:48.526638 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9020b6c1-b9ce-4a58-96d4-1590c592b43f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:48.536859 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9020b6c1-b9ce-4a58-96d4-1590c592b43f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:48.537439 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9020b6c1-b9ce-4a58-96d4-1590c592b43f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:48.538513 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9020b6c1-b9ce-4a58-96d4-1590c592b43f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:48.539094 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9020b6c1-b9ce-4a58-96d4-1590c592b43f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:48.686937 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9020b6c1-b9ce-4a58-96d4-1590c592b43f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:48.695104 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9020b6c1-b9ce-4a58-96d4-1590c592b43f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1266 microversion: 2.1 time: 0.175729 Jun 23 17:21:48.695728 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 448/912] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:21:48 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:21:49.193196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-13338be5-3b64-43cc-8c95-2e18696bdd0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:49.193861 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-13338be5-3b64-43cc-8c95-2e18696bdd0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:49.200685 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-13338be5-3b64-43cc-8c95-2e18696bdd0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:49.201125 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-13338be5-3b64-43cc-8c95-2e18696bdd0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:49.201999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-13338be5-3b64-43cc-8c95-2e18696bdd0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:49.202702 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-13338be5-3b64-43cc-8c95-2e18696bdd0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:49.339645 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-13338be5-3b64-43cc-8c95-2e18696bdd0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:49.348125 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-13338be5-3b64-43cc-8c95-2e18696bdd0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:49.349607 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-13338be5-3b64-43cc-8c95-2e18696bdd0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:49.350778 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-13338be5-3b64-43cc-8c95-2e18696bdd0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1723 microversion: 2.20 time: 0.163299 Jun 23 17:21:49.351339 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 465/913] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:49 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:49.712062 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3a1977a0-30f6-4406-bc65-5fbc8e99a005 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:49.712712 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3a1977a0-30f6-4406-bc65-5fbc8e99a005 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:49.719598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3a1977a0-30f6-4406-bc65-5fbc8e99a005 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:49.720045 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3a1977a0-30f6-4406-bc65-5fbc8e99a005 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:49.720816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3a1977a0-30f6-4406-bc65-5fbc8e99a005 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:49.721290 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3a1977a0-30f6-4406-bc65-5fbc8e99a005 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:49.967412 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3a1977a0-30f6-4406-bc65-5fbc8e99a005 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:49.975365 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3a1977a0-30f6-4406-bc65-5fbc8e99a005 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1266 microversion: 2.1 time: 0.267155 Jun 23 17:21:49.975961 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 449/914] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:21:49 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:21:50.377411 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3d5aec83-a3e6-41aa-94cc-72214d268efd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:50.378260 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3d5aec83-a3e6-41aa-94cc-72214d268efd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:50.386069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d5aec83-a3e6-41aa-94cc-72214d268efd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:50.386572 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d5aec83-a3e6-41aa-94cc-72214d268efd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:50.387404 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d5aec83-a3e6-41aa-94cc-72214d268efd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:50.387929 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d5aec83-a3e6-41aa-94cc-72214d268efd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:50.536816 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3d5aec83-a3e6-41aa-94cc-72214d268efd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:50.545370 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3d5aec83-a3e6-41aa-94cc-72214d268efd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:50.546909 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3d5aec83-a3e6-41aa-94cc-72214d268efd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:50.548059 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3d5aec83-a3e6-41aa-94cc-72214d268efd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1723 microversion: 2.20 time: 0.177351 Jun 23 17:21:50.548633 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 466/915] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:50 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:50.996854 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-80ab3ab6-772e-42ea-ba5e-e26663133712 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:50.997721 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-80ab3ab6-772e-42ea-ba5e-e26663133712 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:51.007138 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-80ab3ab6-772e-42ea-ba5e-e26663133712 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:51.007578 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-80ab3ab6-772e-42ea-ba5e-e26663133712 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:51.008326 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-80ab3ab6-772e-42ea-ba5e-e26663133712 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:51.008754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-80ab3ab6-772e-42ea-ba5e-e26663133712 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:51.151397 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-80ab3ab6-772e-42ea-ba5e-e26663133712 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:51.159530 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-80ab3ab6-772e-42ea-ba5e-e26663133712 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1266 microversion: 2.1 time: 0.169572 Jun 23 17:21:51.160101 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 450/916] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:21:50 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:21:51.571519 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-165e3c99-03dc-439f-9701-4902d61d473a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:51.572461 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-165e3c99-03dc-439f-9701-4902d61d473a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:51.582507 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-165e3c99-03dc-439f-9701-4902d61d473a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:51.582954 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-165e3c99-03dc-439f-9701-4902d61d473a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:51.583721 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-165e3c99-03dc-439f-9701-4902d61d473a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:51.584169 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-165e3c99-03dc-439f-9701-4902d61d473a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:51.714859 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-165e3c99-03dc-439f-9701-4902d61d473a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:51.723405 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-165e3c99-03dc-439f-9701-4902d61d473a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:51.724907 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-165e3c99-03dc-439f-9701-4902d61d473a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:51.726087 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-165e3c99-03dc-439f-9701-4902d61d473a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1723 microversion: 2.20 time: 0.161708 Jun 23 17:21:51.726652 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 467/917] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:51 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:52.181374 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c874a9cf-fdaf-4b52-bf13-156abfbaecaa tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:52.182352 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c874a9cf-fdaf-4b52-bf13-156abfbaecaa tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:52.193837 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c874a9cf-fdaf-4b52-bf13-156abfbaecaa tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:52.194603 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c874a9cf-fdaf-4b52-bf13-156abfbaecaa tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:52.195852 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c874a9cf-fdaf-4b52-bf13-156abfbaecaa tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:52.196556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c874a9cf-fdaf-4b52-bf13-156abfbaecaa tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:52.331425 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c874a9cf-fdaf-4b52-bf13-156abfbaecaa tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:52.339545 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c874a9cf-fdaf-4b52-bf13-156abfbaecaa tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1266 microversion: 2.1 time: 0.165779 Jun 23 17:21:52.340115 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 451/918] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:21:52 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:21:52.744818 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c6528008-6a61-4f80-ae19-7a842d130f3d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:52.745423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c6528008-6a61-4f80-ae19-7a842d130f3d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:52.752699 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c6528008-6a61-4f80-ae19-7a842d130f3d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:52.753133 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c6528008-6a61-4f80-ae19-7a842d130f3d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:52.753912 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c6528008-6a61-4f80-ae19-7a842d130f3d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:52.754338 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c6528008-6a61-4f80-ae19-7a842d130f3d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:52.889464 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c6528008-6a61-4f80-ae19-7a842d130f3d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:52.899012 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c6528008-6a61-4f80-ae19-7a842d130f3d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:52.900513 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c6528008-6a61-4f80-ae19-7a842d130f3d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:52.901674 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c6528008-6a61-4f80-ae19-7a842d130f3d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1744 microversion: 2.20 time: 0.160861 Jun 23 17:21:52.902255 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 468/919] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:52 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:53.362196 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f6b4a5a1-0317-4abf-b210-4fd309e9cb1d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:53.363150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f6b4a5a1-0317-4abf-b210-4fd309e9cb1d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:53.374365 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6b4a5a1-0317-4abf-b210-4fd309e9cb1d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:53.375097 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6b4a5a1-0317-4abf-b210-4fd309e9cb1d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:53.376357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6b4a5a1-0317-4abf-b210-4fd309e9cb1d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:53.377336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6b4a5a1-0317-4abf-b210-4fd309e9cb1d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:53.518982 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f6b4a5a1-0317-4abf-b210-4fd309e9cb1d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:53.531131 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f6b4a5a1-0317-4abf-b210-4fd309e9cb1d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1266 microversion: 2.1 time: 0.176340 Jun 23 17:21:53.531962 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 452/920] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:21:53 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:21:53.926978 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a1e132d4-150c-4955-b345-deb88b702701 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:53.927947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a1e132d4-150c-4955-b345-deb88b702701 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:53.939347 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a1e132d4-150c-4955-b345-deb88b702701 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:53.940045 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a1e132d4-150c-4955-b345-deb88b702701 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:53.940927 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a1e132d4-150c-4955-b345-deb88b702701 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:53.941363 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a1e132d4-150c-4955-b345-deb88b702701 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:54.079669 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a1e132d4-150c-4955-b345-deb88b702701 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:54.088296 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a1e132d4-150c-4955-b345-deb88b702701 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:54.089823 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a1e132d4-150c-4955-b345-deb88b702701 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:54.091007 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a1e132d4-150c-4955-b345-deb88b702701 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1744 microversion: 2.20 time: 0.172781 Jun 23 17:21:54.091657 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 469/921] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:53 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:54.552186 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-66faced4-9236-4ae6-9aef-ad6b1dabaad7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:54.552999 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-66faced4-9236-4ae6-9aef-ad6b1dabaad7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:54.560962 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66faced4-9236-4ae6-9aef-ad6b1dabaad7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:54.561483 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66faced4-9236-4ae6-9aef-ad6b1dabaad7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:54.562401 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66faced4-9236-4ae6-9aef-ad6b1dabaad7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:54.562906 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66faced4-9236-4ae6-9aef-ad6b1dabaad7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:54.707607 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-66faced4-9236-4ae6-9aef-ad6b1dabaad7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:54.715459 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-66faced4-9236-4ae6-9aef-ad6b1dabaad7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1266 microversion: 2.1 time: 0.169299 Jun 23 17:21:54.716030 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 453/922] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:21:54 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:21:55.112674 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-cb5176e2-e936-43f8-ad97-3246152acba4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:55.113396 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-cb5176e2-e936-43f8-ad97-3246152acba4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:55.122326 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cb5176e2-e936-43f8-ad97-3246152acba4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:55.123036 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cb5176e2-e936-43f8-ad97-3246152acba4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:55.123956 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cb5176e2-e936-43f8-ad97-3246152acba4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:55.124493 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cb5176e2-e936-43f8-ad97-3246152acba4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:55.223051 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=2 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:21:55.258261 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-cb5176e2-e936-43f8-ad97-3246152acba4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:55.266737 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-cb5176e2-e936-43f8-ad97-3246152acba4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:55.268392 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-cb5176e2-e936-43f8-ad97-3246152acba4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:55.269743 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-cb5176e2-e936-43f8-ad97-3246152acba4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1744 microversion: 2.20 time: 0.163626 Jun 23 17:21:55.270322 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 470/923] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:55 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:55.733647 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-025a8cba-b5b9-4df9-8e96-28c2ef087366 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:55.734196 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-025a8cba-b5b9-4df9-8e96-28c2ef087366 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:55.736234 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:21:55.737127 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:21:55.743713 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-025a8cba-b5b9-4df9-8e96-28c2ef087366 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:55.744154 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-025a8cba-b5b9-4df9-8e96-28c2ef087366 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:55.744934 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-025a8cba-b5b9-4df9-8e96-28c2ef087366 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:55.745386 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-025a8cba-b5b9-4df9-8e96-28c2ef087366 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:55.901324 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-025a8cba-b5b9-4df9-8e96-28c2ef087366 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:55.912160 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-025a8cba-b5b9-4df9-8e96-28c2ef087366 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1266 microversion: 2.1 time: 0.182585 Jun 23 17:21:55.912927 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 454/924] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:21:55 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:21:56.105276 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-7a143b83-607d-4c1b-b1d5-62c0a76e8053 req-79707d61-a8d3-467e-b699-e271f5c63f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65320df8-ae02-4a62-bde7-14088815afcb", "name": "network-vif-plugged", "status": "completed", "tag": "d460160b-555d-4087-b187-9075bf3d3b97"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:21:56.115901 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-7a143b83-607d-4c1b-b1d5-62c0a76e8053 req-79707d61-a8d3-467e-b699-e271f5c63f76 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:56.116666 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-7a143b83-607d-4c1b-b1d5-62c0a76e8053 req-79707d61-a8d3-467e-b699-e271f5c63f76 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:56.130345 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-7a143b83-607d-4c1b-b1d5-62c0a76e8053 req-79707d61-a8d3-467e-b699-e271f5c63f76 service nova] Creating event network-vif-plugged:d460160b-555d-4087-b187-9075bf3d3b97 for instance 65320df8-ae02-4a62-bde7-14088815afcb on hv-cinder-83538 Jun 23 17:21:56.135805 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-7a143b83-607d-4c1b-b1d5-62c0a76e8053 req-79707d61-a8d3-467e-b699-e271f5c63f76 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035718 Jun 23 17:21:56.136481 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 471/925] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:21:56.288549 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7b678a74-3655-456a-bebf-8b202854fd4d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:56.289214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7b678a74-3655-456a-bebf-8b202854fd4d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:56.295939 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7b678a74-3655-456a-bebf-8b202854fd4d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:56.296395 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7b678a74-3655-456a-bebf-8b202854fd4d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:56.297171 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7b678a74-3655-456a-bebf-8b202854fd4d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:56.297635 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7b678a74-3655-456a-bebf-8b202854fd4d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:56.453257 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7b678a74-3655-456a-bebf-8b202854fd4d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:56.466970 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7b678a74-3655-456a-bebf-8b202854fd4d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:56.469477 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7b678a74-3655-456a-bebf-8b202854fd4d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:56.470993 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7b678a74-3655-456a-bebf-8b202854fd4d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1744 microversion: 2.20 time: 0.186553 Jun 23 17:21:56.472193 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 455/926] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:56 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:56.937549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-243d6ec2-1c9d-4301-b104-1ae3472c4f31 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:56.938492 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-243d6ec2-1c9d-4301-b104-1ae3472c4f31 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:56.946075 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-243d6ec2-1c9d-4301-b104-1ae3472c4f31 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:56.946466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-243d6ec2-1c9d-4301-b104-1ae3472c4f31 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:56.947330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-243d6ec2-1c9d-4301-b104-1ae3472c4f31 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:56.947833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-243d6ec2-1c9d-4301-b104-1ae3472c4f31 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:57.086601 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-243d6ec2-1c9d-4301-b104-1ae3472c4f31 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:57.094825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-243d6ec2-1c9d-4301-b104-1ae3472c4f31 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1266 microversion: 2.1 time: 0.164442 Jun 23 17:21:57.095398 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 472/927] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:21:56 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:21:57.493860 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ffe46a4a-c517-49f2-8a56-f1a59f69aada tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:57.494844 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ffe46a4a-c517-49f2-8a56-f1a59f69aada tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:57.506106 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ffe46a4a-c517-49f2-8a56-f1a59f69aada tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:57.506850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ffe46a4a-c517-49f2-8a56-f1a59f69aada tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:57.508100 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ffe46a4a-c517-49f2-8a56-f1a59f69aada tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:57.508822 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ffe46a4a-c517-49f2-8a56-f1a59f69aada tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:57.646367 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ffe46a4a-c517-49f2-8a56-f1a59f69aada tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:57.654665 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ffe46a4a-c517-49f2-8a56-f1a59f69aada tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:57.656150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ffe46a4a-c517-49f2-8a56-f1a59f69aada tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:57.657297 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ffe46a4a-c517-49f2-8a56-f1a59f69aada tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1744 microversion: 2.20 time: 0.170134 Jun 23 17:21:57.658086 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 456/928] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:57 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:58.112115 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5965f751-64ac-4b67-b7ed-f502e0017ca7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:58.112706 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5965f751-64ac-4b67-b7ed-f502e0017ca7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:58.119565 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5965f751-64ac-4b67-b7ed-f502e0017ca7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:58.120013 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5965f751-64ac-4b67-b7ed-f502e0017ca7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:58.120772 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5965f751-64ac-4b67-b7ed-f502e0017ca7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:58.121203 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5965f751-64ac-4b67-b7ed-f502e0017ca7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:58.251815 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5965f751-64ac-4b67-b7ed-f502e0017ca7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:58.259500 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5965f751-64ac-4b67-b7ed-f502e0017ca7 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1266 microversion: 2.1 time: 0.151641 Jun 23 17:21:58.260060 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 473/929] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:21:58 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:21:58.676729 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f18cf1e2-26b0-4f2f-8e95-8b4675e2a914 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:58.677317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f18cf1e2-26b0-4f2f-8e95-8b4675e2a914 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:58.684130 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f18cf1e2-26b0-4f2f-8e95-8b4675e2a914 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:58.684616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f18cf1e2-26b0-4f2f-8e95-8b4675e2a914 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:58.685368 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f18cf1e2-26b0-4f2f-8e95-8b4675e2a914 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:58.685822 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f18cf1e2-26b0-4f2f-8e95-8b4675e2a914 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:58.824852 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f18cf1e2-26b0-4f2f-8e95-8b4675e2a914 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:58.828990 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:21:58.834405 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f18cf1e2-26b0-4f2f-8e95-8b4675e2a914 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:58.836167 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f18cf1e2-26b0-4f2f-8e95-8b4675e2a914 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:58.837330 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f18cf1e2-26b0-4f2f-8e95-8b4675e2a914 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1744 microversion: 2.20 time: 0.165393 Jun 23 17:21:58.844374 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 457/930] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:58 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:21:59.284203 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-12337f27-216d-4b75-a982-9f9e7bcd6774 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:59.285043 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-12337f27-216d-4b75-a982-9f9e7bcd6774 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:59.292241 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12337f27-216d-4b75-a982-9f9e7bcd6774 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:59.292732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12337f27-216d-4b75-a982-9f9e7bcd6774 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:59.293505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12337f27-216d-4b75-a982-9f9e7bcd6774 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:59.293968 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12337f27-216d-4b75-a982-9f9e7bcd6774 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:59.437938 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-12337f27-216d-4b75-a982-9f9e7bcd6774 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:21:59.446070 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-12337f27-216d-4b75-a982-9f9e7bcd6774 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1266 microversion: 2.1 time: 0.172073 Jun 23 17:21:59.446677 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 474/931] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:21:59 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:21:59.856036 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-763ac6bc-57d5-465e-9c0d-4eba88856742 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:21:59.856642 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-763ac6bc-57d5-465e-9c0d-4eba88856742 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:21:59.864084 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-763ac6bc-57d5-465e-9c0d-4eba88856742 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:59.864538 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-763ac6bc-57d5-465e-9c0d-4eba88856742 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:21:59.865311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-763ac6bc-57d5-465e-9c0d-4eba88856742 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:21:59.865744 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-763ac6bc-57d5-465e-9c0d-4eba88856742 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:00.009873 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-763ac6bc-57d5-465e-9c0d-4eba88856742 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:00.019964 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-763ac6bc-57d5-465e-9c0d-4eba88856742 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:00.021990 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-763ac6bc-57d5-465e-9c0d-4eba88856742 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:00.023763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-763ac6bc-57d5-465e-9c0d-4eba88856742 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1739 microversion: 2.20 time: 0.171765 Jun 23 17:22:00.024533 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 458/932] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:21:59 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:00.164508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-01af183d-16e5-4289-a3e2-610874dfd5bc req-d7ef5d57-3a3c-4f71-933b-065b879cd8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f24bd8-8c9f-442b-9c7b-41072c3a09fe", "name": "network-vif-plugged", "status": "completed", "tag": "17209ab7-6d94-4aed-96b3-e29955c001aa"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:22:00.184129 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-01af183d-16e5-4289-a3e2-610874dfd5bc req-d7ef5d57-3a3c-4f71-933b-065b879cd8ca service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:00.184573 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-01af183d-16e5-4289-a3e2-610874dfd5bc req-d7ef5d57-3a3c-4f71-933b-065b879cd8ca service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:00.215002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-01af183d-16e5-4289-a3e2-610874dfd5bc req-d7ef5d57-3a3c-4f71-933b-065b879cd8ca service nova] Creating event network-vif-plugged:17209ab7-6d94-4aed-96b3-e29955c001aa for instance 11f24bd8-8c9f-442b-9c7b-41072c3a09fe on hv-cinder-83538 Jun 23 17:22:00.225125 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-01af183d-16e5-4289-a3e2-610874dfd5bc req-d7ef5d57-3a3c-4f71-933b-065b879cd8ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065377 Jun 23 17:22:00.226071 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 475/933] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:22:00.464282 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-73d64e7b-49b4-4e2d-b93b-5a3b9a22f908 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:00.464929 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-73d64e7b-49b4-4e2d-b93b-5a3b9a22f908 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:00.473104 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-73d64e7b-49b4-4e2d-b93b-5a3b9a22f908 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:00.473549 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-73d64e7b-49b4-4e2d-b93b-5a3b9a22f908 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:00.474378 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-73d64e7b-49b4-4e2d-b93b-5a3b9a22f908 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:00.474839 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-73d64e7b-49b4-4e2d-b93b-5a3b9a22f908 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:00.681109 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-73d64e7b-49b4-4e2d-b93b-5a3b9a22f908 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:00.694715 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-73d64e7b-49b4-4e2d-b93b-5a3b9a22f908 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1266 microversion: 2.1 time: 0.235416 Jun 23 17:22:00.695683 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 459/934] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:00 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:01.044868 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-659dbb2a-86ee-4a69-8249-a2fc1bd4be6e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:01.046332 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-659dbb2a-86ee-4a69-8249-a2fc1bd4be6e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:01.055711 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-659dbb2a-86ee-4a69-8249-a2fc1bd4be6e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:01.056744 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-659dbb2a-86ee-4a69-8249-a2fc1bd4be6e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:01.058169 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-659dbb2a-86ee-4a69-8249-a2fc1bd4be6e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:01.059204 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-659dbb2a-86ee-4a69-8249-a2fc1bd4be6e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:01.065165 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=100 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:01.203797 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-659dbb2a-86ee-4a69-8249-a2fc1bd4be6e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:01.212352 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-659dbb2a-86ee-4a69-8249-a2fc1bd4be6e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:01.214197 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-659dbb2a-86ee-4a69-8249-a2fc1bd4be6e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:01.215481 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-659dbb2a-86ee-4a69-8249-a2fc1bd4be6e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1739 microversion: 2.20 time: 0.175591 Jun 23 17:22:01.226350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 476/935] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:01 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:01.712502 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-713d6228-0f33-4ee6-8a11-f69d6aebec7e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:01.713145 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-713d6228-0f33-4ee6-8a11-f69d6aebec7e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:01.720103 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-713d6228-0f33-4ee6-8a11-f69d6aebec7e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:01.720564 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-713d6228-0f33-4ee6-8a11-f69d6aebec7e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:01.721428 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-713d6228-0f33-4ee6-8a11-f69d6aebec7e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:01.721887 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-713d6228-0f33-4ee6-8a11-f69d6aebec7e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:01.871872 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-713d6228-0f33-4ee6-8a11-f69d6aebec7e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:01.880950 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-713d6228-0f33-4ee6-8a11-f69d6aebec7e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1266 microversion: 2.1 time: 0.172310 Jun 23 17:22:01.881525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 460/936] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:01 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:02.235245 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a8ad135b-ed2e-43b0-83bc-807a6656b3e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:02.236598 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a8ad135b-ed2e-43b0-83bc-807a6656b3e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:02.245008 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a8ad135b-ed2e-43b0-83bc-807a6656b3e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:02.245421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a8ad135b-ed2e-43b0-83bc-807a6656b3e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:02.246637 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a8ad135b-ed2e-43b0-83bc-807a6656b3e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:02.247072 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a8ad135b-ed2e-43b0-83bc-807a6656b3e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:02.396463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a8ad135b-ed2e-43b0-83bc-807a6656b3e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:02.408530 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a8ad135b-ed2e-43b0-83bc-807a6656b3e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:02.411445 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a8ad135b-ed2e-43b0-83bc-807a6656b3e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:02.414171 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a8ad135b-ed2e-43b0-83bc-807a6656b3e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1739 microversion: 2.20 time: 0.183827 Jun 23 17:22:02.415414 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 477/937] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:02 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:02.897852 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5bb4098f-d25c-4ea8-823a-2b1b33c3930f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:02.898576 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5bb4098f-d25c-4ea8-823a-2b1b33c3930f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:02.905783 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5bb4098f-d25c-4ea8-823a-2b1b33c3930f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:02.906268 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5bb4098f-d25c-4ea8-823a-2b1b33c3930f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:02.907057 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5bb4098f-d25c-4ea8-823a-2b1b33c3930f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:02.907495 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5bb4098f-d25c-4ea8-823a-2b1b33c3930f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:03.073579 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5bb4098f-d25c-4ea8-823a-2b1b33c3930f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:03.081211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5bb4098f-d25c-4ea8-823a-2b1b33c3930f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1452 microversion: 2.1 time: 0.187766 Jun 23 17:22:03.081779 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 461/938] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:02 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1452 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:03.097217 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f82d864a-2a18-4c63-938a-91748f40ec5f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:03.097889 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f82d864a-2a18-4c63-938a-91748f40ec5f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:03.104101 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f82d864a-2a18-4c63-938a-91748f40ec5f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:03.104615 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f82d864a-2a18-4c63-938a-91748f40ec5f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:03.105694 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f82d864a-2a18-4c63-938a-91748f40ec5f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:03.106367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f82d864a-2a18-4c63-938a-91748f40ec5f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:03.251882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f82d864a-2a18-4c63-938a-91748f40ec5f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:03.259736 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f82d864a-2a18-4c63-938a-91748f40ec5f tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1452 microversion: 2.1 time: 0.166504 Jun 23 17:22:03.260897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 478/939] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:03 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:03.433269 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-37b3a255-017b-4710-b78f-f108bb986dd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:03.434141 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-37b3a255-017b-4710-b78f-f108bb986dd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:03.440957 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37b3a255-017b-4710-b78f-f108bb986dd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:03.441437 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37b3a255-017b-4710-b78f-f108bb986dd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:03.442181 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37b3a255-017b-4710-b78f-f108bb986dd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:03.442624 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37b3a255-017b-4710-b78f-f108bb986dd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:03.604294 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-37b3a255-017b-4710-b78f-f108bb986dd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:03.616874 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-37b3a255-017b-4710-b78f-f108bb986dd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:03.619938 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-37b3a255-017b-4710-b78f-f108bb986dd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:03.621447 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-37b3a255-017b-4710-b78f-f108bb986dd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1739 microversion: 2.20 time: 0.192243 Jun 23 17:22:03.634115 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 462/940] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:03 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:04.642574 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-47034d85-229a-4ea9-8977-3cfaa89f3b39 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:04.643836 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-47034d85-229a-4ea9-8977-3cfaa89f3b39 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:04.652618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-47034d85-229a-4ea9-8977-3cfaa89f3b39 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:04.653359 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-47034d85-229a-4ea9-8977-3cfaa89f3b39 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:04.654185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-47034d85-229a-4ea9-8977-3cfaa89f3b39 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:04.654634 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-47034d85-229a-4ea9-8977-3cfaa89f3b39 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:05.029155 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-47034d85-229a-4ea9-8977-3cfaa89f3b39 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:05.037929 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-47034d85-229a-4ea9-8977-3cfaa89f3b39 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:05.039427 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-47034d85-229a-4ea9-8977-3cfaa89f3b39 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:05.040575 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-47034d85-229a-4ea9-8977-3cfaa89f3b39 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1739 microversion: 2.20 time: 0.403978 Jun 23 17:22:05.041127 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 479/941] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:04 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1739 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:05.724936 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-5350edb5-4f38-48ce-a1b7-d92816233e62 req-c3083ffe-d3a8-4317-b628-fb6bc177310d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f24bd8-8c9f-442b-9c7b-41072c3a09fe", "tag": "17209ab7-6d94-4aed-96b3-e29955c001aa"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:22:05.735778 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-5350edb5-4f38-48ce-a1b7-d92816233e62 req-c3083ffe-d3a8-4317-b628-fb6bc177310d service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:05.736576 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-5350edb5-4f38-48ce-a1b7-d92816233e62 req-c3083ffe-d3a8-4317-b628-fb6bc177310d service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:05.751075 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-5350edb5-4f38-48ce-a1b7-d92816233e62 req-c3083ffe-d3a8-4317-b628-fb6bc177310d service nova] Creating event network-changed:17209ab7-6d94-4aed-96b3-e29955c001aa for instance 11f24bd8-8c9f-442b-9c7b-41072c3a09fe on hv-cinder-83538 Jun 23 17:22:05.758307 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-5350edb5-4f38-48ce-a1b7-d92816233e62 req-c3083ffe-d3a8-4317-b628-fb6bc177310d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037453 Jun 23 17:22:05.760058 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 463/942] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:22:06.061040 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f1c3b1ea-9d4d-4c41-a157-44d4a69a7799 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:06.065227 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f1c3b1ea-9d4d-4c41-a157-44d4a69a7799 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:06.074410 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f1c3b1ea-9d4d-4c41-a157-44d4a69a7799 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:06.075250 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f1c3b1ea-9d4d-4c41-a157-44d4a69a7799 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:06.076375 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f1c3b1ea-9d4d-4c41-a157-44d4a69a7799 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:06.077176 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f1c3b1ea-9d4d-4c41-a157-44d4a69a7799 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:06.273399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f1c3b1ea-9d4d-4c41-a157-44d4a69a7799 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:06.287638 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f1c3b1ea-9d4d-4c41-a157-44d4a69a7799 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:06.289668 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f1c3b1ea-9d4d-4c41-a157-44d4a69a7799 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:06.291108 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f1c3b1ea-9d4d-4c41-a157-44d4a69a7799 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1739 microversion: 2.20 time: 0.235565 Jun 23 17:22:06.292184 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 480/943] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:06 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:07.311890 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f28022cf-17bc-4063-b501-10a13155e750 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:07.313384 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f28022cf-17bc-4063-b501-10a13155e750 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:07.320802 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f28022cf-17bc-4063-b501-10a13155e750 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:07.321548 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f28022cf-17bc-4063-b501-10a13155e750 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:07.322672 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f28022cf-17bc-4063-b501-10a13155e750 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:07.323272 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f28022cf-17bc-4063-b501-10a13155e750 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:07.473349 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f28022cf-17bc-4063-b501-10a13155e750 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:07.481689 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f28022cf-17bc-4063-b501-10a13155e750 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:07.483190 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f28022cf-17bc-4063-b501-10a13155e750 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:07.484578 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f28022cf-17bc-4063-b501-10a13155e750 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1739 microversion: 2.20 time: 0.177228 Jun 23 17:22:07.495481 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 464/944] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:07 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:08.503172 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-0801d00b-e32d-461c-af8d-5f945f73015a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:08.503949 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-0801d00b-e32d-461c-af8d-5f945f73015a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:08.507950 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=51 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:08.512279 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0801d00b-e32d-461c-af8d-5f945f73015a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:08.512817 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0801d00b-e32d-461c-af8d-5f945f73015a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:08.513707 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0801d00b-e32d-461c-af8d-5f945f73015a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:08.514439 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0801d00b-e32d-461c-af8d-5f945f73015a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:08.663135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-0801d00b-e32d-461c-af8d-5f945f73015a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:08.673100 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-0801d00b-e32d-461c-af8d-5f945f73015a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:08.674150 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-0801d00b-e32d-461c-af8d-5f945f73015a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:08.675774 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-0801d00b-e32d-461c-af8d-5f945f73015a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1739 microversion: 2.20 time: 0.176862 Jun 23 17:22:08.678300 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 481/945] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:08 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:09.193377 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:22:09.193615 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Thu Jun 23 17:22:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:22:09.697556 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ad0d8d2e-a4d1-4597-803f-4d84e8b53209 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:09.698198 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ad0d8d2e-a4d1-4597-803f-4d84e8b53209 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:09.705202 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ad0d8d2e-a4d1-4597-803f-4d84e8b53209 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:09.705664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ad0d8d2e-a4d1-4597-803f-4d84e8b53209 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:09.706457 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ad0d8d2e-a4d1-4597-803f-4d84e8b53209 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:09.706889 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ad0d8d2e-a4d1-4597-803f-4d84e8b53209 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:09.849004 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ad0d8d2e-a4d1-4597-803f-4d84e8b53209 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:09.857823 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ad0d8d2e-a4d1-4597-803f-4d84e8b53209 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:09.859350 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ad0d8d2e-a4d1-4597-803f-4d84e8b53209 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:09.860526 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ad0d8d2e-a4d1-4597-803f-4d84e8b53209 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1739 microversion: 2.20 time: 0.167053 Jun 23 17:22:09.861095 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 465/946] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:09 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:10.879304 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-503c1d6c-b2c6-47ac-acd9-fb5d42f844c7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:10.879878 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-503c1d6c-b2c6-47ac-acd9-fb5d42f844c7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:10.887613 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-503c1d6c-b2c6-47ac-acd9-fb5d42f844c7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:10.888180 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-503c1d6c-b2c6-47ac-acd9-fb5d42f844c7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:10.888971 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-503c1d6c-b2c6-47ac-acd9-fb5d42f844c7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:10.889402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-503c1d6c-b2c6-47ac-acd9-fb5d42f844c7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:11.021831 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-503c1d6c-b2c6-47ac-acd9-fb5d42f844c7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:11.031104 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-503c1d6c-b2c6-47ac-acd9-fb5d42f844c7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:11.032667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-503c1d6c-b2c6-47ac-acd9-fb5d42f844c7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:11.033889 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-503c1d6c-b2c6-47ac-acd9-fb5d42f844c7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1721 microversion: 2.20 time: 0.158645 Jun 23 17:22:11.034450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 482/947] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:10 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:11.942467 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e9e2cd86-f742-44ea-b95e-692d5e1838e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:11.943069 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e9e2cd86-f742-44ea-b95e-692d5e1838e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:11.945322 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:11.951116 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9e2cd86-f742-44ea-b95e-692d5e1838e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:11.951540 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9e2cd86-f742-44ea-b95e-692d5e1838e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:11.952292 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9e2cd86-f742-44ea-b95e-692d5e1838e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:11.952719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9e2cd86-f742-44ea-b95e-692d5e1838e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:11.976905 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e9e2cd86-f742-44ea-b95e-692d5e1838e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538/ips" status: 200 len: 149 microversion: 2.1 time: 0.040814 Jun 23 17:22:11.977463 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 466/948] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 23 17:22:11 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:22:12.053218 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-29af4496-d3c0-4778-b09c-73cd2e733d46 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:12.053814 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-29af4496-d3c0-4778-b09c-73cd2e733d46 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:12.060554 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-29af4496-d3c0-4778-b09c-73cd2e733d46 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:12.060916 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-29af4496-d3c0-4778-b09c-73cd2e733d46 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:12.061674 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-29af4496-d3c0-4778-b09c-73cd2e733d46 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:12.062135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-29af4496-d3c0-4778-b09c-73cd2e733d46 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:12.201474 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-29af4496-d3c0-4778-b09c-73cd2e733d46 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:12.210409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-29af4496-d3c0-4778-b09c-73cd2e733d46 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:12.212218 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-29af4496-d3c0-4778-b09c-73cd2e733d46 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:12.213387 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-29af4496-d3c0-4778-b09c-73cd2e733d46 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1721 microversion: 2.20 time: 0.164752 Jun 23 17:22:12.213952 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 483/949] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:12 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:13.232341 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d6524b47-fb4e-480b-823d-dee30f1c1481 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:13.232948 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d6524b47-fb4e-480b-823d-dee30f1c1481 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:13.240154 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d6524b47-fb4e-480b-823d-dee30f1c1481 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:13.240610 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d6524b47-fb4e-480b-823d-dee30f1c1481 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:13.241497 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d6524b47-fb4e-480b-823d-dee30f1c1481 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:13.241965 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d6524b47-fb4e-480b-823d-dee30f1c1481 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:13.322634 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-96a83d05-562d-40ad-87c0-66acdc9a096c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4874fdf9-8c6d-40a6-affd-9a39eb684b93"}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:22:13.324331 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-96a83d05-562d-40ad-87c0-66acdc9a096c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:13.330798 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-96a83d05-562d-40ad-87c0-66acdc9a096c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:13.331274 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-96a83d05-562d-40ad-87c0-66acdc9a096c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:13.332006 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-96a83d05-562d-40ad-87c0-66acdc9a096c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:13.332521 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-96a83d05-562d-40ad-87c0-66acdc9a096c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:13.380249 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d6524b47-fb4e-480b-823d-dee30f1c1481 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:13.388282 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d6524b47-fb4e-480b-823d-dee30f1c1481 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:13.389778 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d6524b47-fb4e-480b-823d-dee30f1c1481 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:13.390979 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d6524b47-fb4e-480b-823d-dee30f1c1481 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1724 microversion: 2.20 time: 0.162647 Jun 23 17:22:13.391537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 467/950] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:13 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:13.409090 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fef4a4f3-bddf-4db6-a766-193fa751f736 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e48b810a-17f1-4caf-a29e-a648fb58340a"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:22:13.410207 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fef4a4f3-bddf-4db6-a766-193fa751f736 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:13.416304 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fef4a4f3-bddf-4db6-a766-193fa751f736 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:13.416741 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fef4a4f3-bddf-4db6-a766-193fa751f736 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:13.417485 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fef4a4f3-bddf-4db6-a766-193fa751f736 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:13.417937 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fef4a4f3-bddf-4db6-a766-193fa751f736 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:13.742045 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fef4a4f3-bddf-4db6-a766-193fa751f736 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "POST /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.336778 Jun 23 17:22:13.743016 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 468/951] 10.222.0.18 () {62 vars in 1363 bytes} [Thu Jun 23 17:22:13 2022] POST /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/os-volume_attachments => generated 188 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 17:22:13.765926 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-96a83d05-562d-40ad-87c0-66acdc9a096c tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "POST /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.447205 Jun 23 17:22:13.766617 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 484/952] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 23 17:22:13 2022] POST /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538/os-volume_attachments => generated 194 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:22:13.875539 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ce7a43f1-02f4-48fe-b058-b0e9992ed83b tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:22:13.876159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ce7a43f1-02f4-48fe-b058-b0e9992ed83b tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:13.882967 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ce7a43f1-02f4-48fe-b058-b0e9992ed83b tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:13.883405 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ce7a43f1-02f4-48fe-b058-b0e9992ed83b tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:13.884156 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ce7a43f1-02f4-48fe-b058-b0e9992ed83b tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:13.884583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ce7a43f1-02f4-48fe-b058-b0e9992ed83b tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:13.968445 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ce7a43f1-02f4-48fe-b058-b0e9992ed83b tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "POST /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/action" status: 202 len: 0 microversion: 2.20 time: 0.096826 Jun 23 17:22:13.969055 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 469/953] 10.222.0.18 () {62 vars in 1318 bytes} [Thu Jun 23 17:22:13 2022] POST /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:22:13.978428 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ee5dd2a6-0d1e-4ae8-9c2a-8c8fac3562d3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:13.979126 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ee5dd2a6-0d1e-4ae8-9c2a-8c8fac3562d3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:13.985615 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ee5dd2a6-0d1e-4ae8-9c2a-8c8fac3562d3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:13.986101 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ee5dd2a6-0d1e-4ae8-9c2a-8c8fac3562d3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:13.986870 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ee5dd2a6-0d1e-4ae8-9c2a-8c8fac3562d3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:13.987302 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ee5dd2a6-0d1e-4ae8-9c2a-8c8fac3562d3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:14.132403 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ee5dd2a6-0d1e-4ae8-9c2a-8c8fac3562d3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:14.143093 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ee5dd2a6-0d1e-4ae8-9c2a-8c8fac3562d3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:14.144894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ee5dd2a6-0d1e-4ae8-9c2a-8c8fac3562d3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:14.146197 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ee5dd2a6-0d1e-4ae8-9c2a-8c8fac3562d3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1750 microversion: 2.20 time: 0.172651 Jun 23 17:22:14.146903 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 485/954] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:13 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:14.201164 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-917acf20-4bff-43b3-aad8-385e915507d4 req-7d537670-746a-4a59-afda-b4ef24293b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65320df8-ae02-4a62-bde7-14088815afcb", "name": "network-vif-unplugged", "status": "completed", "tag": "d460160b-555d-4087-b187-9075bf3d3b97"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:22:14.210093 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-917acf20-4bff-43b3-aad8-385e915507d4 req-7d537670-746a-4a59-afda-b4ef24293b63 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:14.210560 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-917acf20-4bff-43b3-aad8-385e915507d4 req-7d537670-746a-4a59-afda-b4ef24293b63 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:14.223627 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.compute.server_external_events [req-917acf20-4bff-43b3-aad8-385e915507d4 req-7d537670-746a-4a59-afda-b4ef24293b63 service nova] Unable to find a host for instance 65320df8-ae02-4a62-bde7-14088815afcb. Dropping event network-vif-unplugged {{(pid=117896) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 17:22:14.224624 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-917acf20-4bff-43b3-aad8-385e915507d4 req-7d537670-746a-4a59-afda-b4ef24293b63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027802 Jun 23 17:22:14.225298 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 470/955] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 23 17:22:15.164910 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-795bf36c-3050-46a9-b9cf-2ae05f6b8a12 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:15.165539 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-795bf36c-3050-46a9-b9cf-2ae05f6b8a12 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:15.172073 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-795bf36c-3050-46a9-b9cf-2ae05f6b8a12 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:15.172509 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-795bf36c-3050-46a9-b9cf-2ae05f6b8a12 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:15.173273 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-795bf36c-3050-46a9-b9cf-2ae05f6b8a12 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:15.173701 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-795bf36c-3050-46a9-b9cf-2ae05f6b8a12 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:15.305105 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-795bf36c-3050-46a9-b9cf-2ae05f6b8a12 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:15.313680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-795bf36c-3050-46a9-b9cf-2ae05f6b8a12 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:15.315197 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-795bf36c-3050-46a9-b9cf-2ae05f6b8a12 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:15.316353 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-795bf36c-3050-46a9-b9cf-2ae05f6b8a12 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1752 microversion: 2.20 time: 0.155780 Jun 23 17:22:15.316941 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 486/956] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:15 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 17:22:16.338690 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0d81f748-ecb9-4e6a-a337-ee9ab014af5f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:16.339441 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0d81f748-ecb9-4e6a-a337-ee9ab014af5f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:16.348020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d81f748-ecb9-4e6a-a337-ee9ab014af5f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:16.348568 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d81f748-ecb9-4e6a-a337-ee9ab014af5f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:16.349500 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d81f748-ecb9-4e6a-a337-ee9ab014af5f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:16.350397 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0d81f748-ecb9-4e6a-a337-ee9ab014af5f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:16.487695 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0d81f748-ecb9-4e6a-a337-ee9ab014af5f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:16.500591 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0d81f748-ecb9-4e6a-a337-ee9ab014af5f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:16.503043 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0d81f748-ecb9-4e6a-a337-ee9ab014af5f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:16.504805 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0d81f748-ecb9-4e6a-a337-ee9ab014af5f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1752 microversion: 2.20 time: 0.171585 Jun 23 17:22:16.505630 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 471/957] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:16 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:17.527830 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b2db231d-c675-4561-b6a2-ff9785de0e29 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:17.528765 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b2db231d-c675-4561-b6a2-ff9785de0e29 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:17.539801 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b2db231d-c675-4561-b6a2-ff9785de0e29 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:17.540539 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b2db231d-c675-4561-b6a2-ff9785de0e29 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:17.541873 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b2db231d-c675-4561-b6a2-ff9785de0e29 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:17.542599 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b2db231d-c675-4561-b6a2-ff9785de0e29 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:17.680595 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b2db231d-c675-4561-b6a2-ff9785de0e29 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:17.689516 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b2db231d-c675-4561-b6a2-ff9785de0e29 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:17.691353 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b2db231d-c675-4561-b6a2-ff9785de0e29 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:17.692520 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b2db231d-c675-4561-b6a2-ff9785de0e29 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1752 microversion: 2.20 time: 0.171521 Jun 23 17:22:17.693080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 487/958] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:17 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:18.716128 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0b7f1084-0118-4477-9378-798c83ceaaea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:18.716736 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0b7f1084-0118-4477-9378-798c83ceaaea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:18.723247 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b7f1084-0118-4477-9378-798c83ceaaea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:18.723689 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b7f1084-0118-4477-9378-798c83ceaaea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:18.724438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b7f1084-0118-4477-9378-798c83ceaaea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:18.724869 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b7f1084-0118-4477-9378-798c83ceaaea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:18.743073 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:18.853608 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0b7f1084-0118-4477-9378-798c83ceaaea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:18.862603 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0b7f1084-0118-4477-9378-798c83ceaaea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:18.864093 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0b7f1084-0118-4477-9378-798c83ceaaea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:18.865239 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0b7f1084-0118-4477-9378-798c83ceaaea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1752 microversion: 2.20 time: 0.153286 Jun 23 17:22:18.865816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 472/959] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:18 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:19.888211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-58446085-8e2d-435f-a456-811adac20dd3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:19.889221 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-58446085-8e2d-435f-a456-811adac20dd3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:19.899684 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-58446085-8e2d-435f-a456-811adac20dd3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:19.900128 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-58446085-8e2d-435f-a456-811adac20dd3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:19.900880 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-58446085-8e2d-435f-a456-811adac20dd3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:19.901321 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-58446085-8e2d-435f-a456-811adac20dd3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:20.051762 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-58446085-8e2d-435f-a456-811adac20dd3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:20.062312 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-58446085-8e2d-435f-a456-811adac20dd3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:20.064437 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-58446085-8e2d-435f-a456-811adac20dd3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:20.066220 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-58446085-8e2d-435f-a456-811adac20dd3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1752 microversion: 2.20 time: 0.184808 Jun 23 17:22:20.067095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 488/960] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:19 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:21.088663 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d9c526c5-de9b-4366-a2f9-16d3c8c88609 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:21.089250 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d9c526c5-de9b-4366-a2f9-16d3c8c88609 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:21.097462 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d9c526c5-de9b-4366-a2f9-16d3c8c88609 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:21.097968 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d9c526c5-de9b-4366-a2f9-16d3c8c88609 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:21.098723 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d9c526c5-de9b-4366-a2f9-16d3c8c88609 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:21.099152 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d9c526c5-de9b-4366-a2f9-16d3c8c88609 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:21.251153 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d9c526c5-de9b-4366-a2f9-16d3c8c88609 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:21.261701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d9c526c5-de9b-4366-a2f9-16d3c8c88609 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:21.263357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d9c526c5-de9b-4366-a2f9-16d3c8c88609 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:21.264541 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d9c526c5-de9b-4366-a2f9-16d3c8c88609 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1752 microversion: 2.20 time: 0.182419 Jun 23 17:22:21.265097 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 473/961] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:21 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1752 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:21.421732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f666f98d-a223-42d8-a31d-f2b0d2fc7b6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:21.422904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f666f98d-a223-42d8-a31d-f2b0d2fc7b6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:21.430133 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f666f98d-a223-42d8-a31d-f2b0d2fc7b6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:21.431259 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f666f98d-a223-42d8-a31d-f2b0d2fc7b6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:21.432033 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f666f98d-a223-42d8-a31d-f2b0d2fc7b6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:21.432474 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f666f98d-a223-42d8-a31d-f2b0d2fc7b6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:21.524238 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-f666f98d-a223-42d8-a31d-f2b0d2fc7b6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lazy-loading 'services' on Instance uuid bee73e46-ae4e-47fe-908c-9c5c6ace3538 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:22:21.598466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f666f98d-a223-42d8-a31d-f2b0d2fc7b6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538/os-volume_attachments/4874fdf9-8c6d-40a6-affd-9a39eb684b93" status: 202 len: 0 microversion: 2.1 time: 0.180754 Jun 23 17:22:21.598983 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 489/962] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 23 17:22:21 2022] DELETE /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538/os-volume_attachments/4874fdf9-8c6d-40a6-affd-9a39eb684b93 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 17:22:21.607644 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1adf5fe9-4d1e-4005-b9b0-244cd4046176 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:21.608643 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1adf5fe9-4d1e-4005-b9b0-244cd4046176 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:21.620958 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1adf5fe9-4d1e-4005-b9b0-244cd4046176 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:21.621503 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1adf5fe9-4d1e-4005-b9b0-244cd4046176 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:21.622822 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1adf5fe9-4d1e-4005-b9b0-244cd4046176 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:21.623300 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1adf5fe9-4d1e-4005-b9b0-244cd4046176 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:21.655966 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1adf5fe9-4d1e-4005-b9b0-244cd4046176 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052246 Jun 23 17:22:21.656538 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 474/963] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:22:21 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:22:22.289064 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-faac70b9-2ad0-45c8-a2d3-bedeb687921c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:22.290159 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-faac70b9-2ad0-45c8-a2d3-bedeb687921c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:22.297021 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-faac70b9-2ad0-45c8-a2d3-bedeb687921c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:22.297465 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-faac70b9-2ad0-45c8-a2d3-bedeb687921c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:22.298268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-faac70b9-2ad0-45c8-a2d3-bedeb687921c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:22.298699 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-faac70b9-2ad0-45c8-a2d3-bedeb687921c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:22.435978 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-faac70b9-2ad0-45c8-a2d3-bedeb687921c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:22.440064 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:22.447400 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-faac70b9-2ad0-45c8-a2d3-bedeb687921c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:22.448908 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-faac70b9-2ad0-45c8-a2d3-bedeb687921c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:22.450101 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-faac70b9-2ad0-45c8-a2d3-bedeb687921c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.168289 Jun 23 17:22:22.451639 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 490/964] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:22 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:22.669114 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8f7d54d8-8782-4d90-b529-309512709aa9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:22.670062 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8f7d54d8-8782-4d90-b529-309512709aa9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:22.676673 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8f7d54d8-8782-4d90-b529-309512709aa9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:22.677109 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8f7d54d8-8782-4d90-b529-309512709aa9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:22.678256 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8f7d54d8-8782-4d90-b529-309512709aa9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:22.678675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8f7d54d8-8782-4d90-b529-309512709aa9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:22.865149 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8f7d54d8-8782-4d90-b529-309512709aa9 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.200896 Jun 23 17:22:22.865690 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 475/965] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:22:22 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538/os-volume_attachments => generated 25 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 17:22:22.925386 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-bbd92167-d2e4-4742-bfd4-4171fe58ad61 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:22.925921 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-bbd92167-d2e4-4742-bfd4-4171fe58ad61 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:22.933008 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bbd92167-d2e4-4742-bfd4-4171fe58ad61 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:22.933483 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bbd92167-d2e4-4742-bfd4-4171fe58ad61 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:22.934283 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bbd92167-d2e4-4742-bfd4-4171fe58ad61 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:22.934717 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bbd92167-d2e4-4742-bfd4-4171fe58ad61 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:22.964417 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-bbd92167-d2e4-4742-bfd4-4171fe58ad61 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Going to try to terminate instance {{(pid=117897) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:22:23.042745 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-bbd92167-d2e4-4742-bfd4-4171fe58ad61 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 204 len: 0 microversion: 2.1 time: 0.121689 Jun 23 17:22:23.043372 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 491/966] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:22:22 2022] DELETE /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:22:23.052210 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1e69fcf2-9078-42ae-a4b8-b14088ed2640 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:23.053071 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1e69fcf2-9078-42ae-a4b8-b14088ed2640 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:23.059511 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e69fcf2-9078-42ae-a4b8-b14088ed2640 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:23.059964 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e69fcf2-9078-42ae-a4b8-b14088ed2640 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:23.060715 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e69fcf2-9078-42ae-a4b8-b14088ed2640 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:23.061145 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e69fcf2-9078-42ae-a4b8-b14088ed2640 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:23.198247 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1e69fcf2-9078-42ae-a4b8-b14088ed2640 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:23.206160 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1e69fcf2-9078-42ae-a4b8-b14088ed2640 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.158128 Jun 23 17:22:23.206748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 476/967] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:23 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:23.473715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5d8d4af2-f28b-4aa3-8075-bd6ea27952ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:23.474750 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5d8d4af2-f28b-4aa3-8075-bd6ea27952ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:23.482610 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5d8d4af2-f28b-4aa3-8075-bd6ea27952ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:23.483046 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5d8d4af2-f28b-4aa3-8075-bd6ea27952ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:23.483790 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5d8d4af2-f28b-4aa3-8075-bd6ea27952ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:23.484238 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5d8d4af2-f28b-4aa3-8075-bd6ea27952ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:23.627820 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5d8d4af2-f28b-4aa3-8075-bd6ea27952ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:23.637396 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5d8d4af2-f28b-4aa3-8075-bd6ea27952ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:23.638979 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5d8d4af2-f28b-4aa3-8075-bd6ea27952ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:23.640121 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5d8d4af2-f28b-4aa3-8075-bd6ea27952ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.173808 Jun 23 17:22:23.640678 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 492/968] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:23 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:24.224036 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6211d13d-541e-4086-ae27-038bd3618683 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:24.224733 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6211d13d-541e-4086-ae27-038bd3618683 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:24.232071 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6211d13d-541e-4086-ae27-038bd3618683 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:24.232520 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6211d13d-541e-4086-ae27-038bd3618683 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:24.233284 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6211d13d-541e-4086-ae27-038bd3618683 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:24.233721 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6211d13d-541e-4086-ae27-038bd3618683 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:24.374156 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6211d13d-541e-4086-ae27-038bd3618683 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:24.382439 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6211d13d-541e-4086-ae27-038bd3618683 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.162488 Jun 23 17:22:24.383015 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 477/969] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:24 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:24.658299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a99b0293-773e-4f89-9884-f41969f91ac4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:24.658973 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a99b0293-773e-4f89-9884-f41969f91ac4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:24.665426 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a99b0293-773e-4f89-9884-f41969f91ac4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:24.665998 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a99b0293-773e-4f89-9884-f41969f91ac4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:24.666845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a99b0293-773e-4f89-9884-f41969f91ac4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:24.667404 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a99b0293-773e-4f89-9884-f41969f91ac4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:24.839555 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a99b0293-773e-4f89-9884-f41969f91ac4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:24.849533 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a99b0293-773e-4f89-9884-f41969f91ac4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:24.851979 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a99b0293-773e-4f89-9884-f41969f91ac4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:24.853866 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a99b0293-773e-4f89-9884-f41969f91ac4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.199260 Jun 23 17:22:24.854867 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 493/970] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:24 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:25.401138 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b5560d3e-a6d9-4318-aa99-52bb7937e644 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:25.401757 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b5560d3e-a6d9-4318-aa99-52bb7937e644 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:25.408539 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b5560d3e-a6d9-4318-aa99-52bb7937e644 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:25.408983 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b5560d3e-a6d9-4318-aa99-52bb7937e644 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:25.409749 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b5560d3e-a6d9-4318-aa99-52bb7937e644 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:25.410206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b5560d3e-a6d9-4318-aa99-52bb7937e644 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:25.552874 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b5560d3e-a6d9-4318-aa99-52bb7937e644 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:25.560752 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b5560d3e-a6d9-4318-aa99-52bb7937e644 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.163809 Jun 23 17:22:25.561320 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 478/971] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:25 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:25.877384 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3a64e743-3796-4268-ab42-5f7374a63892 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:25.878399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3a64e743-3796-4268-ab42-5f7374a63892 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:25.887634 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a64e743-3796-4268-ab42-5f7374a63892 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:25.888092 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a64e743-3796-4268-ab42-5f7374a63892 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:25.888836 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a64e743-3796-4268-ab42-5f7374a63892 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:25.889269 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3a64e743-3796-4268-ab42-5f7374a63892 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:26.027970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3a64e743-3796-4268-ab42-5f7374a63892 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:26.037380 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3a64e743-3796-4268-ab42-5f7374a63892 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:26.038889 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3a64e743-3796-4268-ab42-5f7374a63892 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:26.040038 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3a64e743-3796-4268-ab42-5f7374a63892 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.169290 Jun 23 17:22:26.040594 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 494/972] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:25 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:26.578751 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ca93d39b-1815-4846-b072-69ac6021ea6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:26.579402 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ca93d39b-1815-4846-b072-69ac6021ea6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:26.586312 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ca93d39b-1815-4846-b072-69ac6021ea6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:26.586757 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ca93d39b-1815-4846-b072-69ac6021ea6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:26.587584 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ca93d39b-1815-4846-b072-69ac6021ea6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:26.588520 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ca93d39b-1815-4846-b072-69ac6021ea6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:26.726682 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ca93d39b-1815-4846-b072-69ac6021ea6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:26.734956 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ca93d39b-1815-4846-b072-69ac6021ea6b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.160180 Jun 23 17:22:26.735532 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 479/973] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:26 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:27.058792 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f08b84e2-c0b8-4de8-973f-cfda45af25f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:27.059407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f08b84e2-c0b8-4de8-973f-cfda45af25f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:27.066304 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f08b84e2-c0b8-4de8-973f-cfda45af25f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:27.066749 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f08b84e2-c0b8-4de8-973f-cfda45af25f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:27.067513 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f08b84e2-c0b8-4de8-973f-cfda45af25f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:27.067951 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f08b84e2-c0b8-4de8-973f-cfda45af25f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:27.207815 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f08b84e2-c0b8-4de8-973f-cfda45af25f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:27.216585 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f08b84e2-c0b8-4de8-973f-cfda45af25f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:27.218342 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f08b84e2-c0b8-4de8-973f-cfda45af25f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:27.219501 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f08b84e2-c0b8-4de8-973f-cfda45af25f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.164775 Jun 23 17:22:27.220063 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 495/974] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:27 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:27.753172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e9d4a041-0697-4ef4-88ff-6d16cd02bae0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:27.753846 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e9d4a041-0697-4ef4-88ff-6d16cd02bae0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:27.760825 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9d4a041-0697-4ef4-88ff-6d16cd02bae0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:27.761466 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9d4a041-0697-4ef4-88ff-6d16cd02bae0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:27.762895 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9d4a041-0697-4ef4-88ff-6d16cd02bae0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:27.763339 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e9d4a041-0697-4ef4-88ff-6d16cd02bae0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:27.913240 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e9d4a041-0697-4ef4-88ff-6d16cd02bae0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:27.921630 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e9d4a041-0697-4ef4-88ff-6d16cd02bae0 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.172364 Jun 23 17:22:27.922336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 480/975] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:27 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:28.241871 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e2474742-acdb-42ab-90d6-aa163c144288 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:28.242442 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e2474742-acdb-42ab-90d6-aa163c144288 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:28.251478 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e2474742-acdb-42ab-90d6-aa163c144288 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:28.251926 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e2474742-acdb-42ab-90d6-aa163c144288 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:28.252681 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e2474742-acdb-42ab-90d6-aa163c144288 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:28.253111 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e2474742-acdb-42ab-90d6-aa163c144288 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:28.393607 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e2474742-acdb-42ab-90d6-aa163c144288 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:28.402493 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e2474742-acdb-42ab-90d6-aa163c144288 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:28.404144 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e2474742-acdb-42ab-90d6-aa163c144288 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:28.405267 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e2474742-acdb-42ab-90d6-aa163c144288 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.169971 Jun 23 17:22:28.406039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 496/976] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:28 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:28.940434 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3dc29490-c394-4633-882a-169c96657957 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:28.941008 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3dc29490-c394-4633-882a-169c96657957 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:28.947429 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3dc29490-c394-4633-882a-169c96657957 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:28.947915 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3dc29490-c394-4633-882a-169c96657957 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:28.948660 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3dc29490-c394-4633-882a-169c96657957 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:28.949087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3dc29490-c394-4633-882a-169c96657957 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:29.087192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3dc29490-c394-4633-882a-169c96657957 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:29.096383 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3dc29490-c394-4633-882a-169c96657957 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.160571 Jun 23 17:22:29.097176 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 481/977] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:28 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:29.425137 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-bef6690d-ed51-4242-a1d0-81b5833a31c0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:29.425726 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-bef6690d-ed51-4242-a1d0-81b5833a31c0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:29.433146 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bef6690d-ed51-4242-a1d0-81b5833a31c0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:29.433598 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bef6690d-ed51-4242-a1d0-81b5833a31c0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:29.434412 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bef6690d-ed51-4242-a1d0-81b5833a31c0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:29.434877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bef6690d-ed51-4242-a1d0-81b5833a31c0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:29.573585 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-bef6690d-ed51-4242-a1d0-81b5833a31c0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:29.582521 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-bef6690d-ed51-4242-a1d0-81b5833a31c0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:29.584007 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-bef6690d-ed51-4242-a1d0-81b5833a31c0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:29.585285 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-bef6690d-ed51-4242-a1d0-81b5833a31c0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.164136 Jun 23 17:22:29.585877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 497/978] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:29 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:30.114094 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-959a3a81-f5d2-4ae0-94f9-743fea6a9503 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:30.114767 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-959a3a81-f5d2-4ae0-94f9-743fea6a9503 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:30.121630 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-959a3a81-f5d2-4ae0-94f9-743fea6a9503 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:30.122109 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-959a3a81-f5d2-4ae0-94f9-743fea6a9503 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:30.123071 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-959a3a81-f5d2-4ae0-94f9-743fea6a9503 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:30.124462 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-959a3a81-f5d2-4ae0-94f9-743fea6a9503 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:30.266973 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-959a3a81-f5d2-4ae0-94f9-743fea6a9503 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:30.275193 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-959a3a81-f5d2-4ae0-94f9-743fea6a9503 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.165124 Jun 23 17:22:30.275771 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 482/979] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:30 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:30.605481 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-822f7041-c504-41af-9c36-bd0054ba6e7e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:30.606125 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-822f7041-c504-41af-9c36-bd0054ba6e7e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:30.613255 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-822f7041-c504-41af-9c36-bd0054ba6e7e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:30.614027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-822f7041-c504-41af-9c36-bd0054ba6e7e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:30.614770 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-822f7041-c504-41af-9c36-bd0054ba6e7e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:30.615193 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-822f7041-c504-41af-9c36-bd0054ba6e7e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:30.774766 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-822f7041-c504-41af-9c36-bd0054ba6e7e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:30.784236 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-822f7041-c504-41af-9c36-bd0054ba6e7e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:30.785722 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-822f7041-c504-41af-9c36-bd0054ba6e7e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:30.786918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-822f7041-c504-41af-9c36-bd0054ba6e7e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.185705 Jun 23 17:22:30.787546 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 498/980] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:30 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:31.294410 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6d3424ce-a06b-490a-b477-cbb5af23f785 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:31.295374 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6d3424ce-a06b-490a-b477-cbb5af23f785 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:31.302992 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6d3424ce-a06b-490a-b477-cbb5af23f785 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:31.303449 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6d3424ce-a06b-490a-b477-cbb5af23f785 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:31.304255 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6d3424ce-a06b-490a-b477-cbb5af23f785 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:31.304694 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6d3424ce-a06b-490a-b477-cbb5af23f785 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:31.441456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6d3424ce-a06b-490a-b477-cbb5af23f785 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:31.449831 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6d3424ce-a06b-490a-b477-cbb5af23f785 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.160083 Jun 23 17:22:31.450841 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 483/981] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:31 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:31.806249 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d645462c-3c9e-4237-8b63-f39312ad4fd1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:31.807537 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d645462c-3c9e-4237-8b63-f39312ad4fd1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:31.815203 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d645462c-3c9e-4237-8b63-f39312ad4fd1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:31.815649 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d645462c-3c9e-4237-8b63-f39312ad4fd1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:31.816405 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d645462c-3c9e-4237-8b63-f39312ad4fd1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:31.816859 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d645462c-3c9e-4237-8b63-f39312ad4fd1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:31.955351 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d645462c-3c9e-4237-8b63-f39312ad4fd1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:31.964275 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d645462c-3c9e-4237-8b63-f39312ad4fd1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:31.965820 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d645462c-3c9e-4237-8b63-f39312ad4fd1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:31.967747 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d645462c-3c9e-4237-8b63-f39312ad4fd1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.165889 Jun 23 17:22:31.968324 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 499/982] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:31 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:32.467588 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cad1319e-9d6e-4658-8b52-acb00f27972e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:32.468192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cad1319e-9d6e-4658-8b52-acb00f27972e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:32.475273 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cad1319e-9d6e-4658-8b52-acb00f27972e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:32.475720 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cad1319e-9d6e-4658-8b52-acb00f27972e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:32.476494 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cad1319e-9d6e-4658-8b52-acb00f27972e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:32.476934 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cad1319e-9d6e-4658-8b52-acb00f27972e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:32.616078 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-cad1319e-9d6e-4658-8b52-acb00f27972e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:32.625505 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cad1319e-9d6e-4658-8b52-acb00f27972e tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.161764 Jun 23 17:22:32.626305 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 484/983] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:32 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:32.986780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3e0d6801-2a64-4f5a-9720-0833ea4ddeea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:32.987396 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3e0d6801-2a64-4f5a-9720-0833ea4ddeea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:32.994634 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3e0d6801-2a64-4f5a-9720-0833ea4ddeea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:32.995177 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3e0d6801-2a64-4f5a-9720-0833ea4ddeea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:32.996017 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3e0d6801-2a64-4f5a-9720-0833ea4ddeea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:32.996520 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3e0d6801-2a64-4f5a-9720-0833ea4ddeea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:33.130033 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3e0d6801-2a64-4f5a-9720-0833ea4ddeea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:33.138989 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3e0d6801-2a64-4f5a-9720-0833ea4ddeea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:33.140084 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3e0d6801-2a64-4f5a-9720-0833ea4ddeea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:33.141232 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3e0d6801-2a64-4f5a-9720-0833ea4ddeea tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.158760 Jun 23 17:22:33.141834 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 500/984] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:32 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:33.643923 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4c2ed056-441c-493b-b099-54f0059e45cb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:33.644542 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4c2ed056-441c-493b-b099-54f0059e45cb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:33.651971 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4c2ed056-441c-493b-b099-54f0059e45cb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:33.652682 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4c2ed056-441c-493b-b099-54f0059e45cb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:33.653473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4c2ed056-441c-493b-b099-54f0059e45cb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:33.655890 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4c2ed056-441c-493b-b099-54f0059e45cb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:33.793518 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4c2ed056-441c-493b-b099-54f0059e45cb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:33.801774 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4c2ed056-441c-493b-b099-54f0059e45cb tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.162647 Jun 23 17:22:33.802573 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 485/985] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:33 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:34.160017 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f6f71738-5267-4006-b89d-b373e12a4684 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:34.160662 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f6f71738-5267-4006-b89d-b373e12a4684 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:34.168018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f6f71738-5267-4006-b89d-b373e12a4684 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:34.168534 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f6f71738-5267-4006-b89d-b373e12a4684 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:34.169384 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f6f71738-5267-4006-b89d-b373e12a4684 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:34.169872 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f6f71738-5267-4006-b89d-b373e12a4684 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:34.308382 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f6f71738-5267-4006-b89d-b373e12a4684 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:34.318786 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f6f71738-5267-4006-b89d-b373e12a4684 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:34.320303 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f6f71738-5267-4006-b89d-b373e12a4684 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:34.321488 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f6f71738-5267-4006-b89d-b373e12a4684 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.165466 Jun 23 17:22:34.322085 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 501/986] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:34 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:34.820718 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-58cd3e67-fd73-4e24-a080-9723d816ab44 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:34.821426 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-58cd3e67-fd73-4e24-a080-9723d816ab44 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:34.827644 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-58cd3e67-fd73-4e24-a080-9723d816ab44 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:34.828513 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-58cd3e67-fd73-4e24-a080-9723d816ab44 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:34.829272 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-58cd3e67-fd73-4e24-a080-9723d816ab44 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:34.830565 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-58cd3e67-fd73-4e24-a080-9723d816ab44 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:34.969326 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-58cd3e67-fd73-4e24-a080-9723d816ab44 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:34.977552 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-58cd3e67-fd73-4e24-a080-9723d816ab44 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.161813 Jun 23 17:22:34.978395 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 486/987] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:34 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:35.341113 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4b11c36c-8961-4674-b38a-cf02ec002a82 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:35.341785 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4b11c36c-8961-4674-b38a-cf02ec002a82 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:35.351260 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4b11c36c-8961-4674-b38a-cf02ec002a82 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:35.351863 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4b11c36c-8961-4674-b38a-cf02ec002a82 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:35.352590 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4b11c36c-8961-4674-b38a-cf02ec002a82 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:35.353233 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4b11c36c-8961-4674-b38a-cf02ec002a82 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:35.503497 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4b11c36c-8961-4674-b38a-cf02ec002a82 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:35.515992 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4b11c36c-8961-4674-b38a-cf02ec002a82 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:35.517654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4b11c36c-8961-4674-b38a-cf02ec002a82 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:35.518845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4b11c36c-8961-4674-b38a-cf02ec002a82 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.182909 Jun 23 17:22:35.519402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 502/988] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:35 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:35.995457 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-02528fd0-8fbc-4477-b720-897d7b3fe3ed tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:35.996080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-02528fd0-8fbc-4477-b720-897d7b3fe3ed tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:36.003950 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-02528fd0-8fbc-4477-b720-897d7b3fe3ed tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:36.004426 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-02528fd0-8fbc-4477-b720-897d7b3fe3ed tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:36.005172 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-02528fd0-8fbc-4477-b720-897d7b3fe3ed tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:36.005607 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-02528fd0-8fbc-4477-b720-897d7b3fe3ed tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:36.147123 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-02528fd0-8fbc-4477-b720-897d7b3fe3ed tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:36.156351 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-02528fd0-8fbc-4477-b720-897d7b3fe3ed tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.164704 Jun 23 17:22:36.157228 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 487/989] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:35 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:36.541352 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1b414855-324f-4a54-a531-7909a02194a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:36.542357 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1b414855-324f-4a54-a531-7909a02194a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:36.554092 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1b414855-324f-4a54-a531-7909a02194a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:36.554822 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1b414855-324f-4a54-a531-7909a02194a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:36.556058 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1b414855-324f-4a54-a531-7909a02194a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:36.556793 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1b414855-324f-4a54-a531-7909a02194a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:36.695313 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1b414855-324f-4a54-a531-7909a02194a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:36.707877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1b414855-324f-4a54-a531-7909a02194a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:36.710157 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1b414855-324f-4a54-a531-7909a02194a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:36.711905 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1b414855-324f-4a54-a531-7909a02194a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.176800 Jun 23 17:22:36.712768 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 503/990] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:36 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:37.186667 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-29b1069f-ecb8-4961-a35f-c96dfc297985 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:37.187357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-29b1069f-ecb8-4961-a35f-c96dfc297985 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:37.197054 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-29b1069f-ecb8-4961-a35f-c96dfc297985 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:37.197636 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-29b1069f-ecb8-4961-a35f-c96dfc297985 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:37.198724 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-29b1069f-ecb8-4961-a35f-c96dfc297985 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:37.199313 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-29b1069f-ecb8-4961-a35f-c96dfc297985 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:37.338320 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-29b1069f-ecb8-4961-a35f-c96dfc297985 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:37.346960 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-29b1069f-ecb8-4961-a35f-c96dfc297985 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.170017 Jun 23 17:22:37.347524 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 488/991] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:37 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:37.732804 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-50d5c628-b028-46bf-a057-90e2aa16dc11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:37.733636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-50d5c628-b028-46bf-a057-90e2aa16dc11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:37.740768 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-50d5c628-b028-46bf-a057-90e2aa16dc11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:37.741215 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-50d5c628-b028-46bf-a057-90e2aa16dc11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:37.742015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-50d5c628-b028-46bf-a057-90e2aa16dc11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:37.742450 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-50d5c628-b028-46bf-a057-90e2aa16dc11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:37.881730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-50d5c628-b028-46bf-a057-90e2aa16dc11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:37.892845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-50d5c628-b028-46bf-a057-90e2aa16dc11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:37.894361 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-50d5c628-b028-46bf-a057-90e2aa16dc11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:37.895497 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-50d5c628-b028-46bf-a057-90e2aa16dc11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.166693 Jun 23 17:22:37.896057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 504/992] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:37 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:38.368332 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-72dbec76-828c-41ef-93f9-c467fb36f40d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:38.369542 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-72dbec76-828c-41ef-93f9-c467fb36f40d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:38.380746 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-72dbec76-828c-41ef-93f9-c467fb36f40d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:38.381493 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-72dbec76-828c-41ef-93f9-c467fb36f40d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:38.382802 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-72dbec76-828c-41ef-93f9-c467fb36f40d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:38.383524 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-72dbec76-828c-41ef-93f9-c467fb36f40d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:38.389921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:38.525056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-72dbec76-828c-41ef-93f9-c467fb36f40d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:38.532812 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-72dbec76-828c-41ef-93f9-c467fb36f40d tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.171098 Jun 23 17:22:38.533377 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 489/993] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:38 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:38.914328 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a7dee10c-d668-41bc-963c-ca04828d60c9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:38.914948 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a7dee10c-d668-41bc-963c-ca04828d60c9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:38.917475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:38.923065 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a7dee10c-d668-41bc-963c-ca04828d60c9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:38.923509 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a7dee10c-d668-41bc-963c-ca04828d60c9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:38.924273 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a7dee10c-d668-41bc-963c-ca04828d60c9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:38.924711 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a7dee10c-d668-41bc-963c-ca04828d60c9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:39.061122 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a7dee10c-d668-41bc-963c-ca04828d60c9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:39.064648 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:39.070508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a7dee10c-d668-41bc-963c-ca04828d60c9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:39.072008 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a7dee10c-d668-41bc-963c-ca04828d60c9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:39.073156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a7dee10c-d668-41bc-963c-ca04828d60c9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.163002 Jun 23 17:22:39.073712 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 505/994] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:38 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:39.554902 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-364f1e41-3ccb-44fd-a665-48aa796ef7e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:39.555831 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-364f1e41-3ccb-44fd-a665-48aa796ef7e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:39.565061 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-364f1e41-3ccb-44fd-a665-48aa796ef7e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:39.565511 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-364f1e41-3ccb-44fd-a665-48aa796ef7e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:39.566311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-364f1e41-3ccb-44fd-a665-48aa796ef7e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:39.566744 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-364f1e41-3ccb-44fd-a665-48aa796ef7e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:39.706029 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-364f1e41-3ccb-44fd-a665-48aa796ef7e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:39.717340 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-364f1e41-3ccb-44fd-a665-48aa796ef7e8 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.169519 Jun 23 17:22:39.718029 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 490/995] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:39 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:40.096104 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7e0b2d31-1561-4d4f-af34-f550a9e280f7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:40.097120 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7e0b2d31-1561-4d4f-af34-f550a9e280f7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:40.109964 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7e0b2d31-1561-4d4f-af34-f550a9e280f7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:40.110405 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7e0b2d31-1561-4d4f-af34-f550a9e280f7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:40.111166 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7e0b2d31-1561-4d4f-af34-f550a9e280f7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:40.111596 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7e0b2d31-1561-4d4f-af34-f550a9e280f7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:40.267407 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7e0b2d31-1561-4d4f-af34-f550a9e280f7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:40.278659 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7e0b2d31-1561-4d4f-af34-f550a9e280f7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:40.280394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7e0b2d31-1561-4d4f-af34-f550a9e280f7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:40.281687 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7e0b2d31-1561-4d4f-af34-f550a9e280f7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.192179 Jun 23 17:22:40.282307 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 506/996] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:40 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:40.735483 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-214c007b-d0c6-4ddd-b308-48bd577e79c3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:40.736064 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-214c007b-d0c6-4ddd-b308-48bd577e79c3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:40.742778 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-214c007b-d0c6-4ddd-b308-48bd577e79c3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:40.743222 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-214c007b-d0c6-4ddd-b308-48bd577e79c3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:40.743977 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-214c007b-d0c6-4ddd-b308-48bd577e79c3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:40.744433 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-214c007b-d0c6-4ddd-b308-48bd577e79c3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:40.935955 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-214c007b-d0c6-4ddd-b308-48bd577e79c3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6a4d6c1f834720a69ee30d5ae63cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201cf53eaff642e78cf394182b0b9972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:40.945673 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-214c007b-d0c6-4ddd-b308-48bd577e79c3 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 200 len: 1680 microversion: 2.1 time: 0.214391 Jun 23 17:22:40.946290 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 491/997] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:40 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:22:41.272535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-98a20f13-7a30-4ed2-9f4f-f35e2876800f req-36323d49-74d5-409c-92a6-7227234445fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee73e46-ae4e-47fe-908c-9c5c6ace3538", "name": "network-vif-deleted", "tag": "54a11b14-2779-4d3f-a5d5-48f66702f69f"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:22:41.283128 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-98a20f13-7a30-4ed2-9f4f-f35e2876800f req-36323d49-74d5-409c-92a6-7227234445fd service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:41.283544 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-98a20f13-7a30-4ed2-9f4f-f35e2876800f req-36323d49-74d5-409c-92a6-7227234445fd service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:41.295739 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-98a20f13-7a30-4ed2-9f4f-f35e2876800f req-36323d49-74d5-409c-92a6-7227234445fd service nova] Creating event network-vif-deleted:54a11b14-2779-4d3f-a5d5-48f66702f69f for instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 on hv-cinder-83538 Jun 23 17:22:41.301099 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-98a20f13-7a30-4ed2-9f4f-f35e2876800f req-36323d49-74d5-409c-92a6-7227234445fd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032384 Jun 23 17:22:41.304871 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 507/998] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:22:41.308602 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0c8731ec-d723-4532-aa25-f04abeab9168 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:41.309300 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0c8731ec-d723-4532-aa25-f04abeab9168 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:41.318245 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c8731ec-d723-4532-aa25-f04abeab9168 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:41.318856 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c8731ec-d723-4532-aa25-f04abeab9168 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:41.319635 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c8731ec-d723-4532-aa25-f04abeab9168 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:41.320058 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c8731ec-d723-4532-aa25-f04abeab9168 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:41.473967 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0c8731ec-d723-4532-aa25-f04abeab9168 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:41.483200 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0c8731ec-d723-4532-aa25-f04abeab9168 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:41.486024 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0c8731ec-d723-4532-aa25-f04abeab9168 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:41.487924 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0c8731ec-d723-4532-aa25-f04abeab9168 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.190885 Jun 23 17:22:41.488833 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 492/999] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:41 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:41.963824 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-774ddafb-d058-48fa-ae1f-a64dc9864882 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:41.964504 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-774ddafb-d058-48fa-ae1f-a64dc9864882 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:41.971385 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-774ddafb-d058-48fa-ae1f-a64dc9864882 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:41.971868 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-774ddafb-d058-48fa-ae1f-a64dc9864882 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:41.972632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-774ddafb-d058-48fa-ae1f-a64dc9864882 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:41.973062 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-774ddafb-d058-48fa-ae1f-a64dc9864882 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:41.987274 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-774ddafb-d058-48fa-ae1f-a64dc9864882 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] HTTP exception thrown: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-774ddafb-d058-48fa-ae1f-a64dc9864882 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Request method failure captured: Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 HTTP/1.1 Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7iwY6C5zaqNRYLxueUq43muN0MHe54Fc4Vi8vUs_FNvBOzPmyPl2Y8AX6pFx2OI3hqvDvcKTZrFu8kIfpY_ykWG-5HAqbUcRHhG3HFFYy7PKAmD1gcfEdkk0kUs8MeaKA3KSx5FzNY4j9As2Ih8lkR3_iOjjcRNTH7mXCIBr57mgM Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:22:41.988882 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:22:41.990540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_201cf53eaff642e78cf394182b0b9972", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}] Jun 23 17:22:41.990540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:41.990540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:41.990540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:41.990540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:41.990540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:22:41.990540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:22:41.990540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: fc6a4d6c1f834720a69ee30d5ae63cc9 Jun 23 17:22:41.990540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:41.990540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:22:41.990540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:41.990540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': 'bee73e46-ae4e-47fe-908c-9c5c6ace3538'} Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:41.991423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:41.993032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:41.994435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-774ddafb-d058-48fa-ae1f-a64dc9864882 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Returning 404 to user: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:41.994435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-774ddafb-d058-48fa-ae1f-a64dc9864882 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 404 len: 111 microversion: 2.1 time: 0.030966 Jun 23 17:22:41.994435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 508/1000] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:41 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 17:22:41.999667 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8b6ca13b-527e-4832-bb6c-73dec7cbf819 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '.version_select at 0x7f343247a790>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:42.006686 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=56 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:42.021876 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8b6ca13b-527e-4832-bb6c-73dec7cbf819 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132401785" status: 202 len: 0 microversion: 2.1 time: 0.026064 Jun 23 17:22:42.022437 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 493/1001] 10.222.0.18 () {58 vars in 1220 bytes} [Thu Jun 23 17:22:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132401785 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:22:42.506028 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-19d36a8c-d5cc-4740-9d34-a86f4ba3274f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:42.506775 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-19d36a8c-d5cc-4740-9d34-a86f4ba3274f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:42.513318 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-19d36a8c-d5cc-4740-9d34-a86f4ba3274f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:42.513689 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-19d36a8c-d5cc-4740-9d34-a86f4ba3274f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:42.514489 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-19d36a8c-d5cc-4740-9d34-a86f4ba3274f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:42.515116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-19d36a8c-d5cc-4740-9d34-a86f4ba3274f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:42.650997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-19d36a8c-d5cc-4740-9d34-a86f4ba3274f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:42.657026 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-19d36a8c-d5cc-4740-9d34-a86f4ba3274f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:42.658332 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-19d36a8c-d5cc-4740-9d34-a86f4ba3274f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:42.659492 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-19d36a8c-d5cc-4740-9d34-a86f4ba3274f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.157549 Jun 23 17:22:42.660022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 509/1002] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:42 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:43.683723 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3ad16333-bdf2-4cb6-8c77-db77294327b5 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:43.684725 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3ad16333-bdf2-4cb6-8c77-db77294327b5 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:43.697158 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3ad16333-bdf2-4cb6-8c77-db77294327b5 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:43.698178 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3ad16333-bdf2-4cb6-8c77-db77294327b5 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:43.699713 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3ad16333-bdf2-4cb6-8c77-db77294327b5 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:43.700455 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3ad16333-bdf2-4cb6-8c77-db77294327b5 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:43.798638 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fe310c0b-c24d-4c0a-8f6f-6cabd92a5c76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:43.799530 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fe310c0b-c24d-4c0a-8f6f-6cabd92a5c76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:43.809601 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fe310c0b-c24d-4c0a-8f6f-6cabd92a5c76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:43.810499 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fe310c0b-c24d-4c0a-8f6f-6cabd92a5c76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:43.811884 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fe310c0b-c24d-4c0a-8f6f-6cabd92a5c76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:43.812707 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fe310c0b-c24d-4c0a-8f6f-6cabd92a5c76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:43.827555 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-fe310c0b-c24d-4c0a-8f6f-6cabd92a5c76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] HTTP exception thrown: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fe310c0b-c24d-4c0a-8f6f-6cabd92a5c76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Request method failure captured: Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: DELETE /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 HTTP/1.1 Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7iwY6C5zaqNRYLxueUq43muN0MHe54Fc4Vi8vUs_FNvBOzPmyPl2Y8AX6pFx2OI3hqvDvcKTZrFu8kIfpY_ykWG-5HAqbUcRHhG3HFFYy7PKAmD1gcfEdkk0kUs8MeaKA3KSx5FzNY4j9As2Ih8lkR3_iOjjcRNTH7mXCIBr57mgM Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:22:43.829116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:22:43.830732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_201cf53eaff642e78cf394182b0b9972", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}] Jun 23 17:22:43.830732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:43.830732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:43.830732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:43.830732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:43.830732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:22:43.830732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:22:43.830732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: fc6a4d6c1f834720a69ee30d5ae63cc9 Jun 23 17:22:43.830732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:43.830732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:22:43.830732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:43.830732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': 'bee73e46-ae4e-47fe-908c-9c5c6ace3538'} Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:43.831570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:43.832840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:43.834548 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fe310c0b-c24d-4c0a-8f6f-6cabd92a5c76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Returning 404 to user: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:43.834548 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-fe310c0b-c24d-4c0a-8f6f-6cabd92a5c76 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 404 len: 111 microversion: 2.1 time: 0.036707 Jun 23 17:22:43.834548 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 510/1003] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:22:43 2022] DELETE /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:22:43.838784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4c236754-e909-4840-938f-a6e2dd190142 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:43.839382 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4c236754-e909-4840-938f-a6e2dd190142 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: bee73e46-ae4e-47fe-908c-9c5c6ace3538] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:43.845750 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4c236754-e909-4840-938f-a6e2dd190142 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:43.846200 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4c236754-e909-4840-938f-a6e2dd190142 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:43.846952 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4c236754-e909-4840-938f-a6e2dd190142 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:43.847467 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4c236754-e909-4840-938f-a6e2dd190142 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:43.848670 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3ad16333-bdf2-4cb6-8c77-db77294327b5 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:43.857524 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3ad16333-bdf2-4cb6-8c77-db77294327b5 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:43.859359 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3ad16333-bdf2-4cb6-8c77-db77294327b5 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:43.860525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3ad16333-bdf2-4cb6-8c77-db77294327b5 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.184835 Jun 23 17:22:43.861092 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 494/1004] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:43 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:43.863226 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-4c236754-e909-4840-938f-a6e2dd190142 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] HTTP exception thrown: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4c236754-e909-4840-938f-a6e2dd190142 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Request method failure captured: Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 HTTP/1.1 Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7iwY6C5zaqNRYLxueUq43muN0MHe54Fc4Vi8vUs_FNvBOzPmyPl2Y8AX6pFx2OI3hqvDvcKTZrFu8kIfpY_ykWG-5HAqbUcRHhG3HFFYy7PKAmD1gcfEdkk0kUs8MeaKA3KSx5FzNY4j9As2Ih8lkR3_iOjjcRNTH7mXCIBr57mgM Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:22:43.864730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:22:43.866341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_201cf53eaff642e78cf394182b0b9972", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}] Jun 23 17:22:43.866341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:43.866341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:43.866341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:43.866341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:43.866341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:22:43.866341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:22:43.866341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: fc6a4d6c1f834720a69ee30d5ae63cc9 Jun 23 17:22:43.866341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:43.866341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:22:43.866341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:43.866341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': 'bee73e46-ae4e-47fe-908c-9c5c6ace3538'} Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:43.867145 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. Jun 23 17:22:43.868466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:43.869658 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4c236754-e909-4840-938f-a6e2dd190142 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Returning 404 to user: Instance bee73e46-ae4e-47fe-908c-9c5c6ace3538 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:43.869658 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4c236754-e909-4840-938f-a6e2dd190142 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538" status: 404 len: 111 microversion: 2.1 time: 0.030925 Jun 23 17:22:43.869658 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 511/1005] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:43 2022] GET /compute/v2.1/servers/bee73e46-ae4e-47fe-908c-9c5c6ace3538 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 17:22:44.880220 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-42e8669c-c4b0-4268-a826-6524b98aa8fd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:44.880876 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-42e8669c-c4b0-4268-a826-6524b98aa8fd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:44.887946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42e8669c-c4b0-4268-a826-6524b98aa8fd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:44.888393 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42e8669c-c4b0-4268-a826-6524b98aa8fd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:44.889164 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42e8669c-c4b0-4268-a826-6524b98aa8fd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:44.889597 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42e8669c-c4b0-4268-a826-6524b98aa8fd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:45.011360 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fc6506d9-c78c-4706-bff9-fba97a749d7b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:45.011889 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fc6506d9-c78c-4706-bff9-fba97a749d7b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:45.018840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc6506d9-c78c-4706-bff9-fba97a749d7b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:45.019316 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc6506d9-c78c-4706-bff9-fba97a749d7b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:45.020085 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc6506d9-c78c-4706-bff9-fba97a749d7b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:45.020515 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc6506d9-c78c-4706-bff9-fba97a749d7b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:45.027153 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-42e8669c-c4b0-4268-a826-6524b98aa8fd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:45.036561 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-42e8669c-c4b0-4268-a826-6524b98aa8fd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:45.038227 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-42e8669c-c4b0-4268-a826-6524b98aa8fd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:45.039523 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-42e8669c-c4b0-4268-a826-6524b98aa8fd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.163365 Jun 23 17:22:45.040148 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 495/1006] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:44 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:45.187607 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-fc6506d9-c78c-4706-bff9-fba97a749d7b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] HTTP exception thrown: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fc6506d9-c78c-4706-bff9-fba97a749d7b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Request method failure captured: Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: DELETE /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b HTTP/1.1 Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7iwY6C5zaqNRYLxueUq43muN0MHe54Fc4Vi8vUs_FNvBOzPmyPl2Y8AX6pFx2OI3hqvDvcKTZrFu8kIfpY_ykWG-5HAqbUcRHhG3HFFYy7PKAmD1gcfEdkk0kUs8MeaKA3KSx5FzNY4j9As2Ih8lkR3_iOjjcRNTH7mXCIBr57mgM Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:22:45.189278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:22:45.190784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_201cf53eaff642e78cf394182b0b9972", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}] Jun 23 17:22:45.190784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:45.190784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:45.190784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:45.190784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:45.190784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:22:45.190784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:22:45.190784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: fc6a4d6c1f834720a69ee30d5ae63cc9 Jun 23 17:22:45.190784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:45.190784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:22:45.190784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:22:45.190784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '51605a4b-853e-479f-a3e6-f09880c23d5b'} Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:45.191698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:22:45.193248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.194906 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fc6506d9-c78c-4706-bff9-fba97a749d7b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Returning 404 to user: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:45.194906 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-fc6506d9-c78c-4706-bff9-fba97a749d7b tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 404 len: 111 microversion: 2.1 time: 0.183308 Jun 23 17:22:45.194906 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 512/1007] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:22:45 2022] DELETE /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:22:45.199417 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6abd430d-4c07-4f8a-81a9-fe247cc90bc1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:45.200027 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6abd430d-4c07-4f8a-81a9-fe247cc90bc1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: 51605a4b-853e-479f-a3e6-f09880c23d5b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:45.206956 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6abd430d-4c07-4f8a-81a9-fe247cc90bc1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:45.207338 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6abd430d-4c07-4f8a-81a9-fe247cc90bc1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:45.208093 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6abd430d-4c07-4f8a-81a9-fe247cc90bc1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:45.208525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6abd430d-4c07-4f8a-81a9-fe247cc90bc1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:45.222158 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-6abd430d-4c07-4f8a-81a9-fe247cc90bc1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] HTTP exception thrown: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6abd430d-4c07-4f8a-81a9-fe247cc90bc1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Request method failure captured: Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b HTTP/1.1 Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ7iwY6C5zaqNRYLxueUq43muN0MHe54Fc4Vi8vUs_FNvBOzPmyPl2Y8AX6pFx2OI3hqvDvcKTZrFu8kIfpY_ykWG-5HAqbUcRHhG3HFFYy7PKAmD1gcfEdkk0kUs8MeaKA3KSx5FzNY4j9As2Ih8lkR3_iOjjcRNTH7mXCIBr57mgM Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:22:45.223850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:22:45.225357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_201cf53eaff642e78cf394182b0b9972", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}] Jun 23 17:22:45.225357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:45.225357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:45.225357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:45.225357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:45.225357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:22:45.225357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:22:45.225357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: fc6a4d6c1f834720a69ee30d5ae63cc9 Jun 23 17:22:45.225357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:45.225357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:22:45.225357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:22:45.225357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '51605a4b-853e-479f-a3e6-f09880c23d5b'} Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:45.226525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. Jun 23 17:22:45.228161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.229695 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6abd430d-4c07-4f8a-81a9-fe247cc90bc1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Returning 404 to user: Instance 51605a4b-853e-479f-a3e6-f09880c23d5b could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:45.229695 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6abd430d-4c07-4f8a-81a9-fe247cc90bc1 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b" status: 404 len: 111 microversion: 2.1 time: 0.029757 Jun 23 17:22:45.229695 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 496/1008] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:45 2022] GET /compute/v2.1/servers/51605a4b-853e-479f-a3e6-f09880c23d5b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:22:45.233699 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5b152eed-4f30-427f-8165-dfaacae39472 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:45.234227 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5b152eed-4f30-427f-8165-dfaacae39472 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:45.241135 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5b152eed-4f30-427f-8165-dfaacae39472 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:45.241574 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5b152eed-4f30-427f-8165-dfaacae39472 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:45.242369 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5b152eed-4f30-427f-8165-dfaacae39472 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:45.242797 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5b152eed-4f30-427f-8165-dfaacae39472 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:45.256832 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-5b152eed-4f30-427f-8165-dfaacae39472 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] HTTP exception thrown: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5b152eed-4f30-427f-8165-dfaacae39472 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Request method failure captured: Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: DELETE /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 HTTP/1.1 Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7iwY6C5zaqNRYLxueUq43muN0MHe54Fc4Vi8vUs_FNvBOzPmyPl2Y8AX6pFx2OI3hqvDvcKTZrFu8kIfpY_ykWG-5HAqbUcRHhG3HFFYy7PKAmD1gcfEdkk0kUs8MeaKA3KSx5FzNY4j9As2Ih8lkR3_iOjjcRNTH7mXCIBr57mgM Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:22:45.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:22:45.259904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_201cf53eaff642e78cf394182b0b9972", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}] Jun 23 17:22:45.259904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:45.259904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:45.259904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:45.259904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:45.259904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:22:45.259904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:22:45.259904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: fc6a4d6c1f834720a69ee30d5ae63cc9 Jun 23 17:22:45.259904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:45.259904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:22:45.259904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:22:45.259904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': 'a5991769-2ad6-41ff-a83c-2164828f7811'} Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:45.260661 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:22:45.261932 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.263178 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5b152eed-4f30-427f-8165-dfaacae39472 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Returning 404 to user: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:45.263178 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5b152eed-4f30-427f-8165-dfaacae39472 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 404 len: 111 microversion: 2.1 time: 0.029994 Jun 23 17:22:45.263178 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 513/1009] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:22:45 2022] DELETE /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:22:45.268518 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-074ff026-cca7-49c4-8df0-f02b2859fd5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:45.269121 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-074ff026-cca7-49c4-8df0-f02b2859fd5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: a5991769-2ad6-41ff-a83c-2164828f7811] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:45.275447 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-074ff026-cca7-49c4-8df0-f02b2859fd5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:45.275892 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-074ff026-cca7-49c4-8df0-f02b2859fd5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:45.276676 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-074ff026-cca7-49c4-8df0-f02b2859fd5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:45.278022 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-074ff026-cca7-49c4-8df0-f02b2859fd5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:45.291366 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-074ff026-cca7-49c4-8df0-f02b2859fd5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] HTTP exception thrown: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-074ff026-cca7-49c4-8df0-f02b2859fd5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Request method failure captured: Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 HTTP/1.1 Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ7iwY6C5zaqNRYLxueUq43muN0MHe54Fc4Vi8vUs_FNvBOzPmyPl2Y8AX6pFx2OI3hqvDvcKTZrFu8kIfpY_ykWG-5HAqbUcRHhG3HFFYy7PKAmD1gcfEdkk0kUs8MeaKA3KSx5FzNY4j9As2Ih8lkR3_iOjjcRNTH7mXCIBr57mgM Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:22:45.292882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:22:45.294456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_201cf53eaff642e78cf394182b0b9972", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}] Jun 23 17:22:45.294456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:45.294456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:45.294456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:45.294456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:45.294456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:22:45.294456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:22:45.294456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: fc6a4d6c1f834720a69ee30d5ae63cc9 Jun 23 17:22:45.294456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:45.294456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:22:45.294456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:22:45.294456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': 'a5991769-2ad6-41ff-a83c-2164828f7811'} Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:45.295335 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. Jun 23 17:22:45.296818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:45.298718 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-074ff026-cca7-49c4-8df0-f02b2859fd5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Returning 404 to user: Instance a5991769-2ad6-41ff-a83c-2164828f7811 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:45.298718 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-074ff026-cca7-49c4-8df0-f02b2859fd5a tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811" status: 404 len: 111 microversion: 2.1 time: 0.029650 Jun 23 17:22:45.298718 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 497/1010] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:45 2022] GET /compute/v2.1/servers/a5991769-2ad6-41ff-a83c-2164828f7811 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:22:46.062840 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-8e031388-46cf-435d-a25c-5ca4fffcfdb7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:46.064849 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-8e031388-46cf-435d-a25c-5ca4fffcfdb7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:46.076111 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8e031388-46cf-435d-a25c-5ca4fffcfdb7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:46.076867 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8e031388-46cf-435d-a25c-5ca4fffcfdb7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:46.078182 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8e031388-46cf-435d-a25c-5ca4fffcfdb7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:46.079541 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8e031388-46cf-435d-a25c-5ca4fffcfdb7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:46.227904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-8e031388-46cf-435d-a25c-5ca4fffcfdb7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:46.241039 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-8e031388-46cf-435d-a25c-5ca4fffcfdb7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:46.243130 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-8e031388-46cf-435d-a25c-5ca4fffcfdb7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:46.244796 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-8e031388-46cf-435d-a25c-5ca4fffcfdb7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.188352 Jun 23 17:22:46.245461 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 514/1011] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:46 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:46.449341 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f6345a26-8f86-4f9a-88dc-9731ae9284ff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:46.449904 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f6345a26-8f86-4f9a-88dc-9731ae9284ff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:46.456848 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6345a26-8f86-4f9a-88dc-9731ae9284ff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:46.457578 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6345a26-8f86-4f9a-88dc-9731ae9284ff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:46.458369 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6345a26-8f86-4f9a-88dc-9731ae9284ff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:46.458799 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6345a26-8f86-4f9a-88dc-9731ae9284ff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:46.473528 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-f6345a26-8f86-4f9a-88dc-9731ae9284ff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] HTTP exception thrown: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f6345a26-8f86-4f9a-88dc-9731ae9284ff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Request method failure captured: Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: DELETE /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 HTTP/1.1 Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ7iwY6C5zaqNRYLxueUq43muN0MHe54Fc4Vi8vUs_FNvBOzPmyPl2Y8AX6pFx2OI3hqvDvcKTZrFu8kIfpY_ykWG-5HAqbUcRHhG3HFFYy7PKAmD1gcfEdkk0kUs8MeaKA3KSx5FzNY4j9As2Ih8lkR3_iOjjcRNTH7mXCIBr57mgM Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:22:46.475087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:22:46.476619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_201cf53eaff642e78cf394182b0b9972", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}] Jun 23 17:22:46.476619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:46.476619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:46.476619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:46.476619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:46.476619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:22:46.476619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:22:46.476619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: fc6a4d6c1f834720a69ee30d5ae63cc9 Jun 23 17:22:46.476619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:46.476619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:22:46.476619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:22:46.476619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': 'c4d75741-4c24-4377-baeb-d11dc232c879'} Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:46.477486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:22:46.478981 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:46.480347 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f6345a26-8f86-4f9a-88dc-9731ae9284ff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Returning 404 to user: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:46.480347 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f6345a26-8f86-4f9a-88dc-9731ae9284ff tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 404 len: 111 microversion: 2.1 time: 0.031079 Jun 23 17:22:46.480347 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 498/1012] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:22:46 2022] DELETE /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:22:46.485076 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b9ae2458-413b-4c64-af38-e4330e1fc330 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:46.485906 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b9ae2458-413b-4c64-af38-e4330e1fc330 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] [instance: c4d75741-4c24-4377-baeb-d11dc232c879] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:46.492426 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b9ae2458-413b-4c64-af38-e4330e1fc330 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:46.492870 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b9ae2458-413b-4c64-af38-e4330e1fc330 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:46.493627 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b9ae2458-413b-4c64-af38-e4330e1fc330 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:46.494096 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b9ae2458-413b-4c64-af38-e4330e1fc330 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:46.508218 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-b9ae2458-413b-4c64-af38-e4330e1fc330 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] HTTP exception thrown: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b9ae2458-413b-4c64-af38-e4330e1fc330 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Request method failure captured: Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 HTTP/1.1 Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ7iwY6C5zaqNRYLxueUq43muN0MHe54Fc4Vi8vUs_FNvBOzPmyPl2Y8AX6pFx2OI3hqvDvcKTZrFu8kIfpY_ykWG-5HAqbUcRHhG3HFFYy7PKAmD1gcfEdkk0kUs8MeaKA3KSx5FzNY4j9As2Ih8lkR3_iOjjcRNTH7mXCIBr57mgM Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:22:46.509724 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:22:46.511330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_201cf53eaff642e78cf394182b0b9972", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/201cf53eaff642e78cf394182b0b9972"}]}] Jun 23 17:22:46.511330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:46.511330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 201cf53eaff642e78cf394182b0b9972 Jun 23 17:22:46.511330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1409013216 Jun 23 17:22:46.511330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:46.511330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:22:46.511330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:22:46.511330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: fc6a4d6c1f834720a69ee30d5ae63cc9 Jun 23 17:22:46.511330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-AttachVolumeNegativeTest-1409013216-project Jun 23 17:22:46.511330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:22:46.511330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:22:46.511330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': 'c4d75741-4c24-4377-baeb-d11dc232c879'} Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:46.512196 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. Jun 23 17:22:46.513632 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:46.515060 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b9ae2458-413b-4c64-af38-e4330e1fc330 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] Returning 404 to user: Instance c4d75741-4c24-4377-baeb-d11dc232c879 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:46.515060 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b9ae2458-413b-4c64-af38-e4330e1fc330 tempest-AttachVolumeNegativeTest-1409013216 tempest-AttachVolumeNegativeTest-1409013216-project] 10.222.0.18 "GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879" status: 404 len: 111 microversion: 2.1 time: 0.030129 Jun 23 17:22:46.515060 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 515/1013] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:22:46 2022] GET /compute/v2.1/servers/c4d75741-4c24-4377-baeb-d11dc232c879 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:22:47.265000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-954280d9-23f5-4753-965e-86da8d584c0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:47.265709 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-954280d9-23f5-4753-965e-86da8d584c0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:47.272405 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-954280d9-23f5-4753-965e-86da8d584c0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:47.272841 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-954280d9-23f5-4753-965e-86da8d584c0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:47.273608 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-954280d9-23f5-4753-965e-86da8d584c0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:47.274067 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-954280d9-23f5-4753-965e-86da8d584c0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:47.406317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-954280d9-23f5-4753-965e-86da8d584c0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:47.415560 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-954280d9-23f5-4753-965e-86da8d584c0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:47.417568 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-954280d9-23f5-4753-965e-86da8d584c0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:47.418333 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-954280d9-23f5-4753-965e-86da8d584c0f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.157574 Jun 23 17:22:47.418902 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 499/1014] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:47 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:48.436869 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-eaae2eb3-87ea-40a3-9ac0-f2e02448dc21 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:48.437823 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-eaae2eb3-87ea-40a3-9ac0-f2e02448dc21 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:48.445940 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eaae2eb3-87ea-40a3-9ac0-f2e02448dc21 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:48.446845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eaae2eb3-87ea-40a3-9ac0-f2e02448dc21 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:48.447700 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eaae2eb3-87ea-40a3-9ac0-f2e02448dc21 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:48.448256 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-eaae2eb3-87ea-40a3-9ac0-f2e02448dc21 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:48.730972 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-eaae2eb3-87ea-40a3-9ac0-f2e02448dc21 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:48.745857 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-eaae2eb3-87ea-40a3-9ac0-f2e02448dc21 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:48.747664 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-eaae2eb3-87ea-40a3-9ac0-f2e02448dc21 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:48.749511 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-eaae2eb3-87ea-40a3-9ac0-f2e02448dc21 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.316669 Jun 23 17:22:48.761984 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 516/1015] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:48 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:49.776546 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-dfaea087-bbf5-4c23-b92a-e34f2323ade9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:49.777185 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-dfaea087-bbf5-4c23-b92a-e34f2323ade9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:49.786607 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfaea087-bbf5-4c23-b92a-e34f2323ade9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:49.786898 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfaea087-bbf5-4c23-b92a-e34f2323ade9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:49.788236 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfaea087-bbf5-4c23-b92a-e34f2323ade9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:49.788916 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfaea087-bbf5-4c23-b92a-e34f2323ade9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:49.948278 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-dfaea087-bbf5-4c23-b92a-e34f2323ade9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:49.959280 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-dfaea087-bbf5-4c23-b92a-e34f2323ade9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:49.960842 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-dfaea087-bbf5-4c23-b92a-e34f2323ade9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:49.962127 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-dfaea087-bbf5-4c23-b92a-e34f2323ade9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.194698 Jun 23 17:22:49.962941 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 500/1016] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:49 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:50.441634 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-b799a3cb-0f8d-41d9-8ffb-dbe4e6213449 req-3351fbce-356d-4c93-947e-27f2290325f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65320df8-ae02-4a62-bde7-14088815afcb", "name": "network-vif-plugged", "status": "completed", "tag": "d460160b-555d-4087-b187-9075bf3d3b97"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:22:50.451835 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-b799a3cb-0f8d-41d9-8ffb-dbe4e6213449 req-3351fbce-356d-4c93-947e-27f2290325f2 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:50.452360 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-b799a3cb-0f8d-41d9-8ffb-dbe4e6213449 req-3351fbce-356d-4c93-947e-27f2290325f2 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:50.464467 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-b799a3cb-0f8d-41d9-8ffb-dbe4e6213449 req-3351fbce-356d-4c93-947e-27f2290325f2 service nova] Creating event network-vif-plugged:d460160b-555d-4087-b187-9075bf3d3b97 for instance 65320df8-ae02-4a62-bde7-14088815afcb on hv-cinder-83538 Jun 23 17:22:50.469890 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-b799a3cb-0f8d-41d9-8ffb-dbe4e6213449 req-3351fbce-356d-4c93-947e-27f2290325f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032298 Jun 23 17:22:50.470869 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 517/1017] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:22:50.980346 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5f4758ca-d171-4c4a-8c19-dc5e83216787 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:50.980921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5f4758ca-d171-4c4a-8c19-dc5e83216787 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:50.988673 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f4758ca-d171-4c4a-8c19-dc5e83216787 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:50.989116 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f4758ca-d171-4c4a-8c19-dc5e83216787 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:50.989886 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f4758ca-d171-4c4a-8c19-dc5e83216787 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:50.990318 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f4758ca-d171-4c4a-8c19-dc5e83216787 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:51.128351 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-98aed1ca-2aa5-483a-a0d0-50ff46960e23 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Action: 'create', calling method: .version_select at 0x7f342d9ed8b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1942803468", "metadata": {"Type": "work"}}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-98aed1ca-2aa5-483a-a0d0-50ff46960e23 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Request method failure captured: Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 122 Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitKFqO-3CMZJ3Pmax_St5hhxik4E_ZugsEbF0UKQ7mnlqiQixK0wEmxoI7azu3fQ-d8Ci5IAhw-Ptodhpyhx02hqQwNyYya-p0_acPZJTx_aVaWj1EymraU3_s3OJaUkDL3J27ulUyOSPeIMp-EBu_2f2kWpmbPcRO6OeQBINzxRQtrU Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 1296c86ec7434578b08c6acbb7c3c357 Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:22:51.144833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:22:51.146444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1296c86ec7434578b08c6acbb7c3c357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1296c86ec7434578b08c6acbb7c3c357"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1296c86ec7434578b08c6acbb7c3c357", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1296c86ec7434578b08c6acbb7c3c357"}]}] Jun 23 17:22:51.146444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.146444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 1296c86ec7434578b08c6acbb7c3c357 Jun 23 17:22:51.146444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.146444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-VolumesNegativeTest-2064341906-project Jun 23 17:22:51.146444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:22:51.146444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:22:51.146444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 353832e827a24bccae721bc95f50fa1f Jun 23 17:22:51.146444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-VolumesNegativeTest-2064341906-project Jun 23 17:22:51.146444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Jun 23 17:22:51.146444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1942803468", "metadata": {"Type": "work"}}} Jun 23 17:22:51.146444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: Jun 23 17:22:51.146444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1942803468', 'metadata': {'Type': 'work'}}}} Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise error Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi '#$%' Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:51.147784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 17:22:51.149495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 17:22:51.150942 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 17:22:51.150942 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.150942 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-98aed1ca-2aa5-483a-a0d0-50ff46960e23 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:51.150942 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-98aed1ca-2aa5-483a-a0d0-50ff46960e23 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.139663 Jun 23 17:22:51.150942 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 518/1018] 10.222.0.18 () {60 vars in 1155 bytes} [Thu Jun 23 17:22:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 23 17:22:51.157652 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-cc4c7d6b-52ca-4930-831e-421801e92661 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Action: 'create', calling method: .version_select at 0x7f342da23d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2100232720", "metadata": {"Type": "work"}}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-cc4c7d6b-52ca-4930-831e-421801e92661 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Request method failure captured: Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 120 Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitKFqO-3CMZJ3Pmax_St5hhxik4E_ZugsEbF0UKQ7mnlqiQixK0wEmxoI7azu3fQ-d8Ci5IAhw-Ptodhpyhx02hqQwNyYya-p0_acPZJTx_aVaWj1EymraU3_s3OJaUkDL3J27ulUyOSPeIMp-EBu_2f2kWpmbPcRO6OeQBINzxRQtrU Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 1296c86ec7434578b08c6acbb7c3c357 Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:22:51.159997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:22:51.161490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1296c86ec7434578b08c6acbb7c3c357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1296c86ec7434578b08c6acbb7c3c357"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1296c86ec7434578b08c6acbb7c3c357", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1296c86ec7434578b08c6acbb7c3c357"}]}] Jun 23 17:22:51.161490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.161490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 1296c86ec7434578b08c6acbb7c3c357 Jun 23 17:22:51.161490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.161490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-VolumesNegativeTest-2064341906-project Jun 23 17:22:51.161490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:22:51.161490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:22:51.161490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 353832e827a24bccae721bc95f50fa1f Jun 23 17:22:51.161490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-VolumesNegativeTest-2064341906-project Jun 23 17:22:51.161490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Jun 23 17:22:51.161490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2100232720", "metadata": {"Type": "work"}}} Jun 23 17:22:51.161490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: Jun 23 17:22:51.161490 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2100232720', 'metadata': {'Type': 'work'}}}} Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise error Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi '0' Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:51.162399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 17:22:51.164505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 17:22:51.166415 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 17:22:51.166415 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.166415 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-cc4c7d6b-52ca-4930-831e-421801e92661 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:51.166415 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-cc4c7d6b-52ca-4930-831e-421801e92661 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007686 Jun 23 17:22:51.166415 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 519/1019] 10.222.0.18 () {60 vars in 1155 bytes} [Thu Jun 23 17:22:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 17:22:51.166818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f4758ca-d171-4c4a-8c19-dc5e83216787 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:51.173447 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5c6ef480-cd45-4c05-87eb-0d129e65dc2e tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Action: 'create', calling method: .version_select at 0x7f342da23310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1749949088", "metadata": {"Type": "work"}}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:22:51.174005 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f4758ca-d171-4c4a-8c19-dc5e83216787 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:51.175528 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f4758ca-d171-4c4a-8c19-dc5e83216787 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5c6ef480-cd45-4c05-87eb-0d129e65dc2e tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Request method failure captured: Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 119 Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitKFqO-3CMZJ3Pmax_St5hhxik4E_ZugsEbF0UKQ7mnlqiQixK0wEmxoI7azu3fQ-d8Ci5IAhw-Ptodhpyhx02hqQwNyYya-p0_acPZJTx_aVaWj1EymraU3_s3OJaUkDL3J27ulUyOSPeIMp-EBu_2f2kWpmbPcRO6OeQBINzxRQtrU Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 1296c86ec7434578b08c6acbb7c3c357 Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:22:51.175825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:22:51.177549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1296c86ec7434578b08c6acbb7c3c357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1296c86ec7434578b08c6acbb7c3c357"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1296c86ec7434578b08c6acbb7c3c357", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1296c86ec7434578b08c6acbb7c3c357"}]}] Jun 23 17:22:51.177549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.177549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 1296c86ec7434578b08c6acbb7c3c357 Jun 23 17:22:51.177549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.177549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-VolumesNegativeTest-2064341906-project Jun 23 17:22:51.177549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:22:51.177549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:22:51.177549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 353832e827a24bccae721bc95f50fa1f Jun 23 17:22:51.177549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-VolumesNegativeTest-2064341906-project Jun 23 17:22:51.177549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Jun 23 17:22:51.177549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1749949088", "metadata": {"Type": "work"}}} Jun 23 17:22:51.177549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: Jun 23 17:22:51.177549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1749949088', 'metadata': {'Type': 'work'}}}} Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise error Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi '' Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:51.179672 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 17:22:51.182680 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 17:22:51.184267 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 17:22:51.184267 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.184267 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5c6ef480-cd45-4c05-87eb-0d129e65dc2e tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:51.184517 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5f4758ca-d171-4c4a-8c19-dc5e83216787 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.200392 Jun 23 17:22:51.184620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5c6ef480-cd45-4c05-87eb-0d129e65dc2e tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007620 Jun 23 17:22:51.184620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 520/1020] 10.222.0.18 () {60 vars in 1155 bytes} [Thu Jun 23 17:22:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 17:22:51.185207 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 501/1021] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:50 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:51.189905 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4b8d094e-cb13-43bc-b5d2-6c36ffa142a7 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Calling method '.version_select at 0x7f342db071f0>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:51.217762 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-4b8d094e-cb13-43bc-b5d2-6c36ffa142a7 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] HTTP exception thrown: Volume tempest-invalid-1458113954 could not be found. Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4b8d094e-cb13-43bc-b5d2-6c36ffa142a7 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Request method failure captured: Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1458113954 HTTP/1.1 Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitKFqO-3CMZJ3Pmax_St5hhxik4E_ZugsEbF0UKQ7mnlqiQixK0wEmxoI7azu3fQ-d8Ci5IAhw-Ptodhpyhx02hqQwNyYya-p0_acPZJTx_aVaWj1EymraU3_s3OJaUkDL3J27ulUyOSPeIMp-EBu_2f2kWpmbPcRO6OeQBINzxRQtrU Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 1296c86ec7434578b08c6acbb7c3c357 Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:22:51.220463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:22:51.222190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1296c86ec7434578b08c6acbb7c3c357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1296c86ec7434578b08c6acbb7c3c357"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1296c86ec7434578b08c6acbb7c3c357", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1296c86ec7434578b08c6acbb7c3c357"}]}] Jun 23 17:22:51.222190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.222190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 1296c86ec7434578b08c6acbb7c3c357 Jun 23 17:22:51.222190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.222190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-VolumesNegativeTest-2064341906-project Jun 23 17:22:51.222190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:22:51.222190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:22:51.222190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 353832e827a24bccae721bc95f50fa1f Jun 23 17:22:51.222190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-VolumesNegativeTest-2064341906-project Jun 23 17:22:51.222190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: Jun 23 17:22:51.222190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Volume tempest-invalid-1458113954 could not be found. Jun 23 17:22:51.222190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': 'tempest-invalid-1458113954'} Jun 23 17:22:51.222190 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1458113954 could not be found. (HTTP 404) (Request-ID: req-49340f6d-cae2-4694-a245-5df20972f85f) Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.223319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 17:22:51.224781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1458113954 could not be found. Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:22:51.226198 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1458113954 could not be found. Jun 23 17:22:51.228618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.228618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.228618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.228618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.228618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:51.228618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:51.228618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:22:51.228618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:22:51.228618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1458113954 could not be found. Jun 23 17:22:51.228618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.228618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4b8d094e-cb13-43bc-b5d2-6c36ffa142a7 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Returning 404 to user: Volume tempest-invalid-1458113954 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:51.228618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4b8d094e-cb13-43bc-b5d2-6c36ffa142a7 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1458113954" status: 404 len: 99 microversion: 2.1 time: 0.035737 Jun 23 17:22:51.228618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 521/1022] 10.222.0.18 () {58 vars in 1217 bytes} [Thu Jun 23 17:22:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1458113954 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 23 17:22:51.231790 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-617ec7ff-020d-42af-a2e4-43f728cc7a20 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003946 Jun 23 17:22:51.232256 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 502/1023] 10.222.0.18 () {58 vars in 1139 bytes} [Thu Jun 23 17:22:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 17:22:51.241712 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-74c06a47-4c70-48e8-94df-4e69957b4433 tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004348 Jun 23 17:22:51.242315 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 522/1024] 10.222.0.18 () {58 vars in 1136 bytes} [Thu Jun 23 17:22:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 23 17:22:51.250322 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5126f2d3-f010-4d2e-8991-5c964e0ac0ba tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Calling method '.version_select at 0x7f3432431dc0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:51.278486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-5126f2d3-f010-4d2e-8991-5c964e0ac0ba tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] HTTP exception thrown: Volume 4db4f70a-fc20-4043-aac4-06fc3daab4a0 could not be found. Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5126f2d3-f010-4d2e-8991-5c964e0ac0ba tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Request method failure captured: Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: DELETE /compute/v2.1/os-volumes/4db4f70a-fc20-4043-aac4-06fc3daab4a0 HTTP/1.1 Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitKFqO-3CMZJ3Pmax_St5hhxik4E_ZugsEbF0UKQ7mnlqiQixK0wEmxoI7azu3fQ-d8Ci5IAhw-Ptodhpyhx02hqQwNyYya-p0_acPZJTx_aVaWj1EymraU3_s3OJaUkDL3J27ulUyOSPeIMp-EBu_2f2kWpmbPcRO6OeQBINzxRQtrU Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: 1296c86ec7434578b08c6acbb7c3c357 Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:22:51.280748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:22:51.282930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1296c86ec7434578b08c6acbb7c3c357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1296c86ec7434578b08c6acbb7c3c357"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1296c86ec7434578b08c6acbb7c3c357", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1296c86ec7434578b08c6acbb7c3c357"}]}] Jun 23 17:22:51.282930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.282930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 1296c86ec7434578b08c6acbb7c3c357 Jun 23 17:22:51.282930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.282930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-VolumesNegativeTest-2064341906-project Jun 23 17:22:51.282930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:22:51.282930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:22:51.282930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: 353832e827a24bccae721bc95f50fa1f Jun 23 17:22:51.282930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-VolumesNegativeTest-2064341906-project Jun 23 17:22:51.282930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: Jun 23 17:22:51.282930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Volume 4db4f70a-fc20-4043-aac4-06fc3daab4a0 could not be found. Jun 23 17:22:51.282930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '4db4f70a-fc20-4043-aac4-06fc3daab4a0'} Jun 23 17:22:51.282930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4db4f70a-fc20-4043-aac4-06fc3daab4a0 could not be found. (HTTP 404) (Request-ID: req-52e95ff9-4d46-4612-90de-3c5279115f55) Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.283811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 17:22:51.284974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4db4f70a-fc20-4043-aac4-06fc3daab4a0 could not be found. Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 17:22:51.286192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:22:51.288113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4db4f70a-fc20-4043-aac4-06fc3daab4a0 could not be found. Jun 23 17:22:51.288113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.288113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.288113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.288113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.288113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:51.288113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:51.288113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:22:51.288113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:22:51.288113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4db4f70a-fc20-4043-aac4-06fc3daab4a0 could not be found. Jun 23 17:22:51.288113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.288113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5126f2d3-f010-4d2e-8991-5c964e0ac0ba tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Returning 404 to user: Volume 4db4f70a-fc20-4043-aac4-06fc3daab4a0 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:51.288113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5126f2d3-f010-4d2e-8991-5c964e0ac0ba tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/4db4f70a-fc20-4043-aac4-06fc3daab4a0" status: 404 len: 109 microversion: 2.1 time: 0.035359 Jun 23 17:22:51.288113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 503/1025] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 23 17:22:51 2022] DELETE /compute/v2.1/os-volumes/4db4f70a-fc20-4043-aac4-06fc3daab4a0 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 17:22:51.291890 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-2aaab01a-a817-4a82-b345-47fe148772fc tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Calling method '.version_select at 0x7f342da23d30>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:51.330183 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-2aaab01a-a817-4a82-b345-47fe148772fc tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] HTTP exception thrown: Volume 67633330-b200-4208-8b71-d2dd41f3268a could not be found. Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-2aaab01a-a817-4a82-b345-47fe148772fc tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Request method failure captured: Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/os-volumes/67633330-b200-4208-8b71-d2dd41f3268a HTTP/1.1 Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitKFqO-3CMZJ3Pmax_St5hhxik4E_ZugsEbF0UKQ7mnlqiQixK0wEmxoI7azu3fQ-d8Ci5IAhw-Ptodhpyhx02hqQwNyYya-p0_acPZJTx_aVaWj1EymraU3_s3OJaUkDL3J27ulUyOSPeIMp-EBu_2f2kWpmbPcRO6OeQBINzxRQtrU Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 1296c86ec7434578b08c6acbb7c3c357 Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:22:51.332069 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:22:51.333715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1296c86ec7434578b08c6acbb7c3c357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1296c86ec7434578b08c6acbb7c3c357"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1296c86ec7434578b08c6acbb7c3c357", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1296c86ec7434578b08c6acbb7c3c357"}]}] Jun 23 17:22:51.333715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.333715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 1296c86ec7434578b08c6acbb7c3c357 Jun 23 17:22:51.333715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-VolumesNegativeTest-2064341906 Jun 23 17:22:51.333715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-VolumesNegativeTest-2064341906-project Jun 23 17:22:51.333715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:22:51.333715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:22:51.333715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 353832e827a24bccae721bc95f50fa1f Jun 23 17:22:51.333715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-VolumesNegativeTest-2064341906-project Jun 23 17:22:51.333715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: Jun 23 17:22:51.333715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Volume 67633330-b200-4208-8b71-d2dd41f3268a could not be found. Jun 23 17:22:51.333715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '67633330-b200-4208-8b71-d2dd41f3268a'} Jun 23 17:22:51.333715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 67633330-b200-4208-8b71-d2dd41f3268a could not be found. (HTTP 404) (Request-ID: req-7894c630-521b-4c05-89a3-06d0d7fb77f7) Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.334947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 17:22:51.336569 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 67633330-b200-4208-8b71-d2dd41f3268a could not be found. Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 17:22:51.337970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:22:51.339350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 67633330-b200-4208-8b71-d2dd41f3268a could not be found. Jun 23 17:22:51.339350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.339350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:22:51.339350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.339350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:22:51.339350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:22:51.339350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:22:51.339350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:22:51.339350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:22:51.339350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 67633330-b200-4208-8b71-d2dd41f3268a could not be found. Jun 23 17:22:51.339350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:22:51.339350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-2aaab01a-a817-4a82-b345-47fe148772fc tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] Returning 404 to user: Volume 67633330-b200-4208-8b71-d2dd41f3268a could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:22:51.339350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-2aaab01a-a817-4a82-b345-47fe148772fc tempest-VolumesNegativeTest-2064341906 tempest-VolumesNegativeTest-2064341906-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/67633330-b200-4208-8b71-d2dd41f3268a" status: 404 len: 109 microversion: 2.1 time: 0.045509 Jun 23 17:22:51.339350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 523/1026] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 23 17:22:51 2022] GET /compute/v2.1/os-volumes/67633330-b200-4208-8b71-d2dd41f3268a => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:22:52.195677 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0a8a4765-0ce9-4fdc-8b91-ced6008c387c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:52.197017 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0a8a4765-0ce9-4fdc-8b91-ced6008c387c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:52.203476 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0a8a4765-0ce9-4fdc-8b91-ced6008c387c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:52.204031 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0a8a4765-0ce9-4fdc-8b91-ced6008c387c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:52.204910 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0a8a4765-0ce9-4fdc-8b91-ced6008c387c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:52.205351 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0a8a4765-0ce9-4fdc-8b91-ced6008c387c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:52.340964 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0a8a4765-0ce9-4fdc-8b91-ced6008c387c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:52.349824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0a8a4765-0ce9-4fdc-8b91-ced6008c387c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:52.351350 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0a8a4765-0ce9-4fdc-8b91-ced6008c387c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:52.352546 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0a8a4765-0ce9-4fdc-8b91-ced6008c387c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.161304 Jun 23 17:22:52.353228 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 504/1027] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:52 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:53.372698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-2a1529e6-d8cf-46d1-9d6e-18bdfd2891dd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:53.373345 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-2a1529e6-d8cf-46d1-9d6e-18bdfd2891dd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:53.381540 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2a1529e6-d8cf-46d1-9d6e-18bdfd2891dd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:53.382018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2a1529e6-d8cf-46d1-9d6e-18bdfd2891dd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:53.382984 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2a1529e6-d8cf-46d1-9d6e-18bdfd2891dd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:53.383424 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2a1529e6-d8cf-46d1-9d6e-18bdfd2891dd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:53.529665 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2a1529e6-d8cf-46d1-9d6e-18bdfd2891dd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:53.538498 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2a1529e6-d8cf-46d1-9d6e-18bdfd2891dd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:53.539979 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2a1529e6-d8cf-46d1-9d6e-18bdfd2891dd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:53.541125 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-2a1529e6-d8cf-46d1-9d6e-18bdfd2891dd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1808 microversion: 2.20 time: 0.173061 Jun 23 17:22:53.541875 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 524/1028] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:53 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:22:54.564366 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fd107683-61c7-4665-b28d-e85ec92e0a26 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:22:54.565485 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fd107683-61c7-4665-b28d-e85ec92e0a26 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:22:54.572863 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fd107683-61c7-4665-b28d-e85ec92e0a26 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:54.573327 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fd107683-61c7-4665-b28d-e85ec92e0a26 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:54.574156 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fd107683-61c7-4665-b28d-e85ec92e0a26 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:22:54.574608 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fd107683-61c7-4665-b28d-e85ec92e0a26 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:22:54.720355 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fd107683-61c7-4665-b28d-e85ec92e0a26 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:54.732241 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fd107683-61c7-4665-b28d-e85ec92e0a26 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:54.733621 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fd107683-61c7-4665-b28d-e85ec92e0a26 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:22:54.734820 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fd107683-61c7-4665-b28d-e85ec92e0a26 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1795 microversion: 2.20 time: 0.177113 Jun 23 17:22:54.735373 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 505/1029] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:22:54 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1795 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:23:32.482262 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-516613633", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "networks": [{"uuid": "621ad951-6b5b-460e-b196-77ea13cf7a1e"}]}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:23:32.489279 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=27 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:32.489953 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=46 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:32.719339 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.network.neutron [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] validate_networks() for [('621ad951-6b5b-460e-b196-77ea13cf7a1e', None, None, None, None, None)] {{(pid=117897) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:23:33.136376 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Flavor limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:23:33.136804 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Image limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:23:33.137274 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Flavor pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:23:33.137676 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Image pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:23:33.138112 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:23:33.147985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:33.148430 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:33.149223 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:33.149653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:33.168947 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Getting quotas for project ac4cd16fac46470eb48bb273b12ac6f0. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:23:33.173137 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Getting quotas for user 9ee5ba617c5f4038930c30773c207a58 and project ac4cd16fac46470eb48bb273b12ac6f0. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:23:33.184936 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Going to run 1 instances... {{(pid=117897) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:23:33.187210 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:23:33.233931 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-54a76d87-f8b0-4fd8-923e-a1c9e1ef30f8 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755624 Jun 23 17:23:33.234576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 525/1030] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:23:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:23:33.244801 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-644f3fd8-b6a7-43fe-be09-f64d439f8957 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:23:33.245495 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-644f3fd8-b6a7-43fe-be09-f64d439f8957 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:23:33.247875 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:33.248574 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=70 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:33.362376 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-644f3fd8-b6a7-43fe-be09-f64d439f8957 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:23:33.369277 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-644f3fd8-b6a7-43fe-be09-f64d439f8957 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 200 len: 1218 microversion: 2.1 time: 0.128426 Jun 23 17:23:33.369840 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 506/1031] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:23:33 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:23:34.387230 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3ae799ba-8915-46f8-9135-92837771220d tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:23:34.388668 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3ae799ba-8915-46f8-9135-92837771220d tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:23:34.395464 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3ae799ba-8915-46f8-9135-92837771220d tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:34.395911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3ae799ba-8915-46f8-9135-92837771220d tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:34.396677 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3ae799ba-8915-46f8-9135-92837771220d tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:34.397116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3ae799ba-8915-46f8-9135-92837771220d tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:34.465959 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3ae799ba-8915-46f8-9135-92837771220d tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:23:34.473768 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3ae799ba-8915-46f8-9135-92837771220d tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 200 len: 1288 microversion: 2.1 time: 0.091265 Jun 23 17:23:34.474352 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 526/1032] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:23:34 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:23:35.492085 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-07da5890-d1f2-4ae6-8562-3c2dd3009314 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:23:35.492770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-07da5890-d1f2-4ae6-8562-3c2dd3009314 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:23:35.499851 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07da5890-d1f2-4ae6-8562-3c2dd3009314 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:35.500392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07da5890-d1f2-4ae6-8562-3c2dd3009314 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:35.501166 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07da5890-d1f2-4ae6-8562-3c2dd3009314 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:35.501596 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07da5890-d1f2-4ae6-8562-3c2dd3009314 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:35.682949 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-07da5890-d1f2-4ae6-8562-3c2dd3009314 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:23:35.691167 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-07da5890-d1f2-4ae6-8562-3c2dd3009314 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 200 len: 1318 microversion: 2.1 time: 0.203243 Jun 23 17:23:35.694980 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 507/1033] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:23:35 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:23:35.838679 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-3034427f-89d6-4188-ba38-41c53a821103 req-ce80f0ab-234c-4bc8-b2c0-ee97cabc401f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95ad824e-0ca7-45df-b884-760e7612a09b", "tag": "95c2c7a4-7a6a-42d4-99c2-f6dfd82c8201"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:23:35.847116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-3034427f-89d6-4188-ba38-41c53a821103 req-ce80f0ab-234c-4bc8-b2c0-ee97cabc401f service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:35.847619 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-3034427f-89d6-4188-ba38-41c53a821103 req-ce80f0ab-234c-4bc8-b2c0-ee97cabc401f service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:35.864965 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-3034427f-89d6-4188-ba38-41c53a821103 req-ce80f0ab-234c-4bc8-b2c0-ee97cabc401f service nova] Creating event network-changed:95c2c7a4-7a6a-42d4-99c2-f6dfd82c8201 for instance 95ad824e-0ca7-45df-b884-760e7612a09b on hv-cinder-83538 Jun 23 17:23:35.872456 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-3034427f-89d6-4188-ba38-41c53a821103 req-ce80f0ab-234c-4bc8-b2c0-ee97cabc401f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108376 Jun 23 17:23:35.873037 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 527/1034] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:23:36.708812 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a672584a-8a0a-4f03-b955-6edd6f3ee185 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:23:36.709440 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a672584a-8a0a-4f03-b955-6edd6f3ee185 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:23:36.716060 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a672584a-8a0a-4f03-b955-6edd6f3ee185 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:36.716503 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a672584a-8a0a-4f03-b955-6edd6f3ee185 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:36.717280 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a672584a-8a0a-4f03-b955-6edd6f3ee185 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:36.717681 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a672584a-8a0a-4f03-b955-6edd6f3ee185 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:36.862767 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a672584a-8a0a-4f03-b955-6edd6f3ee185 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:23:36.870798 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a672584a-8a0a-4f03-b955-6edd6f3ee185 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 200 len: 1318 microversion: 2.1 time: 0.165989 Jun 23 17:23:36.871369 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 508/1035] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:23:36 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:23:37.893645 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-0eb7eef3-2aeb-48e4-a5c0-e6e77a1f5c6c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:23:37.894920 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-0eb7eef3-2aeb-48e4-a5c0-e6e77a1f5c6c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:23:37.902525 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0eb7eef3-2aeb-48e4-a5c0-e6e77a1f5c6c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:37.902974 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0eb7eef3-2aeb-48e4-a5c0-e6e77a1f5c6c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:37.903736 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0eb7eef3-2aeb-48e4-a5c0-e6e77a1f5c6c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:37.904171 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0eb7eef3-2aeb-48e4-a5c0-e6e77a1f5c6c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:38.044999 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-0eb7eef3-2aeb-48e4-a5c0-e6e77a1f5c6c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:23:38.055641 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-0eb7eef3-2aeb-48e4-a5c0-e6e77a1f5c6c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 200 len: 1318 microversion: 2.1 time: 0.169785 Jun 23 17:23:38.056213 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 528/1036] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:23:37 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:23:39.073251 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-803eb910-1690-4a40-841a-d9a76ea9289b tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:23:39.073882 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-803eb910-1690-4a40-841a-d9a76ea9289b tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:23:39.081138 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-803eb910-1690-4a40-841a-d9a76ea9289b tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:39.081582 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-803eb910-1690-4a40-841a-d9a76ea9289b tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:39.082382 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-803eb910-1690-4a40-841a-d9a76ea9289b tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:39.082808 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-803eb910-1690-4a40-841a-d9a76ea9289b tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:39.238982 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-803eb910-1690-4a40-841a-d9a76ea9289b tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:23:39.250416 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-803eb910-1690-4a40-841a-d9a76ea9289b tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 200 len: 1318 microversion: 2.1 time: 0.181480 Jun 23 17:23:39.250972 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 509/1037] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:23:39 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:23:40.271725 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c93cbe62-b5f8-44d6-a182-4f398184a926 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:23:40.272679 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c93cbe62-b5f8-44d6-a182-4f398184a926 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:23:40.279727 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c93cbe62-b5f8-44d6-a182-4f398184a926 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:40.280185 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c93cbe62-b5f8-44d6-a182-4f398184a926 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:40.280918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c93cbe62-b5f8-44d6-a182-4f398184a926 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:40.281350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c93cbe62-b5f8-44d6-a182-4f398184a926 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:40.429761 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c93cbe62-b5f8-44d6-a182-4f398184a926 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:23:40.442772 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c93cbe62-b5f8-44d6-a182-4f398184a926 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 200 len: 1318 microversion: 2.1 time: 0.177302 Jun 23 17:23:40.443685 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 529/1038] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:23:40 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:23:41.465292 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8b850a25-5b2c-4fc5-bbac-a38d0a531296 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:23:41.465919 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8b850a25-5b2c-4fc5-bbac-a38d0a531296 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:23:41.472901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8b850a25-5b2c-4fc5-bbac-a38d0a531296 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:41.473355 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8b850a25-5b2c-4fc5-bbac-a38d0a531296 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:41.474159 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8b850a25-5b2c-4fc5-bbac-a38d0a531296 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:41.474593 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8b850a25-5b2c-4fc5-bbac-a38d0a531296 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:41.613326 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8b850a25-5b2c-4fc5-bbac-a38d0a531296 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:23:41.621602 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8b850a25-5b2c-4fc5-bbac-a38d0a531296 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 200 len: 1318 microversion: 2.1 time: 0.160336 Jun 23 17:23:41.622206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 510/1039] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:23:41 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:23:42.638681 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ac4ea117-042c-486e-8fc0-0d2bd3ee37d0 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:23:42.639263 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ac4ea117-042c-486e-8fc0-0d2bd3ee37d0 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:23:42.646156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ac4ea117-042c-486e-8fc0-0d2bd3ee37d0 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:42.646582 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ac4ea117-042c-486e-8fc0-0d2bd3ee37d0 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:42.647380 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ac4ea117-042c-486e-8fc0-0d2bd3ee37d0 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:42.647849 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ac4ea117-042c-486e-8fc0-0d2bd3ee37d0 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:42.723216 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-9dd18f25-08ee-47dc-8439-46c9b2aff093 req-cbc0251a-e923-46cf-9bd7-290569a42b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ad824e-0ca7-45df-b884-760e7612a09b", "name": "network-vif-plugged", "status": "completed", "tag": "95c2c7a4-7a6a-42d4-99c2-f6dfd82c8201"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:23:42.738782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9dd18f25-08ee-47dc-8439-46c9b2aff093 req-cbc0251a-e923-46cf-9bd7-290569a42b77 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:42.739243 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9dd18f25-08ee-47dc-8439-46c9b2aff093 req-cbc0251a-e923-46cf-9bd7-290569a42b77 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:42.751584 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-9dd18f25-08ee-47dc-8439-46c9b2aff093 req-cbc0251a-e923-46cf-9bd7-290569a42b77 service nova] Creating event network-vif-plugged:95c2c7a4-7a6a-42d4-99c2-f6dfd82c8201 for instance 95ad824e-0ca7-45df-b884-760e7612a09b on hv-cinder-83538 Jun 23 17:23:42.759938 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-9dd18f25-08ee-47dc-8439-46c9b2aff093 req-cbc0251a-e923-46cf-9bd7-290569a42b77 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040746 Jun 23 17:23:42.760965 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 511/1040] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:23:42.781080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-ac4ea117-042c-486e-8fc0-0d2bd3ee37d0 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:23:42.789710 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ac4ea117-042c-486e-8fc0-0d2bd3ee37d0 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 200 len: 1318 microversion: 2.1 time: 0.155022 Jun 23 17:23:42.790367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 530/1041] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:23:42 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:23:43.805535 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:43.810341 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9b0f3436-4534-43e2-8df9-b5b1e9d9d7da tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:23:43.811029 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9b0f3436-4534-43e2-8df9-b5b1e9d9d7da tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:23:43.817826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9b0f3436-4534-43e2-8df9-b5b1e9d9d7da tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:43.818292 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9b0f3436-4534-43e2-8df9-b5b1e9d9d7da tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:43.819046 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9b0f3436-4534-43e2-8df9-b5b1e9d9d7da tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:43.819474 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9b0f3436-4534-43e2-8df9-b5b1e9d9d7da tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:43.866558 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:23:43.867129 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Thu Jun 23 17:23:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:23:43.956497 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9b0f3436-4534-43e2-8df9-b5b1e9d9d7da tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:23:43.964390 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9b0f3436-4534-43e2-8df9-b5b1e9d9d7da tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 200 len: 1318 microversion: 2.1 time: 0.160436 Jun 23 17:23:43.964923 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 512/1042] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:23:43 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:23:44.980770 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-de344b68-ddea-4d35-834a-61e9d64d5676 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:23:44.981394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-de344b68-ddea-4d35-834a-61e9d64d5676 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:23:44.983330 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=2 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:44.984001 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=6 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:44.990894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-de344b68-ddea-4d35-834a-61e9d64d5676 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:44.991449 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-de344b68-ddea-4d35-834a-61e9d64d5676 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:44.992182 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-de344b68-ddea-4d35-834a-61e9d64d5676 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:23:44.992616 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-de344b68-ddea-4d35-834a-61e9d64d5676 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:23:45.132081 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-de344b68-ddea-4d35-834a-61e9d64d5676 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:23:45.140465 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-de344b68-ddea-4d35-834a-61e9d64d5676 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 200 len: 1507 microversion: 2.1 time: 0.163686 Jun 23 17:23:45.141029 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 531/1043] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:23:44 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:02.218619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cb048c81-9b7b-43e6-984d-4ca91e17735e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:02.219195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cb048c81-9b7b-43e6-984d-4ca91e17735e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:02.221256 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=16 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:02.221979 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=32 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:02.227909 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cb048c81-9b7b-43e6-984d-4ca91e17735e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:02.228356 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cb048c81-9b7b-43e6-984d-4ca91e17735e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:02.229204 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cb048c81-9b7b-43e6-984d-4ca91e17735e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:02.229591 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cb048c81-9b7b-43e6-984d-4ca91e17735e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:02.258435 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cb048c81-9b7b-43e6-984d-4ca91e17735e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/os-volume_attachments/e48b810a-17f1-4caf-a29e-a648fb58340a" status: 200 len: 194 microversion: 2.20 time: 0.044014 Jun 23 17:24:02.259024 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 513/1044] 10.222.0.18 () {60 vars in 1453 bytes} [Thu Jun 23 17:24:02 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/os-volume_attachments/e48b810a-17f1-4caf-a29e-a648fb58340a => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:24:02.333499 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-8261f52e-705b-4112-9629-40469d6542ac tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:02.334231 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-8261f52e-705b-4112-9629-40469d6542ac tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:02.336717 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:02.337169 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=34 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:02.343811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8261f52e-705b-4112-9629-40469d6542ac tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:02.344258 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8261f52e-705b-4112-9629-40469d6542ac tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:02.345018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8261f52e-705b-4112-9629-40469d6542ac tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:02.345475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8261f52e-705b-4112-9629-40469d6542ac tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:02.428495 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-8261f52e-705b-4112-9629-40469d6542ac tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lazy-loading 'services' on Instance uuid 65320df8-ae02-4a62-bde7-14088815afcb {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:24:02.505573 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-8261f52e-705b-4112-9629-40469d6542ac tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/os-volume_attachments/e48b810a-17f1-4caf-a29e-a648fb58340a" status: 202 len: 0 microversion: 2.20 time: 0.175917 Jun 23 17:24:02.506191 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 532/1045] 10.222.0.18 () {60 vars in 1456 bytes} [Thu Jun 23 17:24:02 2022] DELETE /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/os-volume_attachments/e48b810a-17f1-4caf-a29e-a648fb58340a => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:24:02.515093 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d5b58e0e-7388-4bfa-b791-5552cce2d08e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:02.516096 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d5b58e0e-7388-4bfa-b791-5552cce2d08e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:02.522689 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5b58e0e-7388-4bfa-b791-5552cce2d08e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:02.523130 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5b58e0e-7388-4bfa-b791-5552cce2d08e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:02.524029 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5b58e0e-7388-4bfa-b791-5552cce2d08e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:02.524466 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5b58e0e-7388-4bfa-b791-5552cce2d08e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:02.555076 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d5b58e0e-7388-4bfa-b791-5552cce2d08e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043785 Jun 23 17:24:02.555485 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 514/1046] 10.222.0.18 () {60 vars in 1342 bytes} [Thu Jun 23 17:24:02 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:24:03.569412 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-811f17f4-2abb-49ac-aac8-b9a69f6c95e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:03.570550 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-811f17f4-2abb-49ac-aac8-b9a69f6c95e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:03.577974 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-811f17f4-2abb-49ac-aac8-b9a69f6c95e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:03.578426 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-811f17f4-2abb-49ac-aac8-b9a69f6c95e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:03.579156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-811f17f4-2abb-49ac-aac8-b9a69f6c95e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:03.579630 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-811f17f4-2abb-49ac-aac8-b9a69f6c95e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:03.610964 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-811f17f4-2abb-49ac-aac8-b9a69f6c95e2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046587 Jun 23 17:24:03.611517 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 533/1047] 10.222.0.18 () {60 vars in 1342 bytes} [Thu Jun 23 17:24:03 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:24:04.627161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-798c7a46-4694-43d5-8a1f-18a178503db6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:04.628866 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-798c7a46-4694-43d5-8a1f-18a178503db6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:04.639807 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-798c7a46-4694-43d5-8a1f-18a178503db6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:04.640252 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-798c7a46-4694-43d5-8a1f-18a178503db6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:04.641013 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-798c7a46-4694-43d5-8a1f-18a178503db6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:04.641438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-798c7a46-4694-43d5-8a1f-18a178503db6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:04.671221 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-798c7a46-4694-43d5-8a1f-18a178503db6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050903 Jun 23 17:24:04.671780 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 515/1048] 10.222.0.18 () {60 vars in 1342 bytes} [Thu Jun 23 17:24:04 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:04.730878 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5cf830e0-4115-4cdb-9f41-1e103a030afb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:04.731376 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5cf830e0-4115-4cdb-9f41-1e103a030afb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:04.738333 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5cf830e0-4115-4cdb-9f41-1e103a030afb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:04.738779 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5cf830e0-4115-4cdb-9f41-1e103a030afb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:04.739526 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5cf830e0-4115-4cdb-9f41-1e103a030afb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:04.739955 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5cf830e0-4115-4cdb-9f41-1e103a030afb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:04.766027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5cf830e0-4115-4cdb-9f41-1e103a030afb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Going to try to terminate instance {{(pid=117897) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:24:04.850133 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5cf830e0-4115-4cdb-9f41-1e103a030afb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 204 len: 0 microversion: 2.20 time: 0.122926 Jun 23 17:24:04.850986 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 534/1049] 10.222.0.18 () {60 vars in 1279 bytes} [Thu Jun 23 17:24:04 2022] DELETE /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 17:24:04.859693 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6282c7a5-2ef1-49f3-8645-559570cf3268 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:04.860337 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6282c7a5-2ef1-49f3-8645-559570cf3268 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:04.868010 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6282c7a5-2ef1-49f3-8645-559570cf3268 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:04.868452 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6282c7a5-2ef1-49f3-8645-559570cf3268 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:04.869238 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6282c7a5-2ef1-49f3-8645-559570cf3268 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:04.869662 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6282c7a5-2ef1-49f3-8645-559570cf3268 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:05.004295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6282c7a5-2ef1-49f3-8645-559570cf3268 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:05.012735 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6282c7a5-2ef1-49f3-8645-559570cf3268 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:05.014503 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6282c7a5-2ef1-49f3-8645-559570cf3268 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:05.015657 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6282c7a5-2ef1-49f3-8645-559570cf3268 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1723 microversion: 2.20 time: 0.160569 Jun 23 17:24:05.016248 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 516/1050] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:04 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 17:24:06.042460 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-30999462-2c4c-4793-8cca-733df0feab27 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:06.043257 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-30999462-2c4c-4793-8cca-733df0feab27 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:06.052447 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30999462-2c4c-4793-8cca-733df0feab27 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:06.053199 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30999462-2c4c-4793-8cca-733df0feab27 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:06.054118 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30999462-2c4c-4793-8cca-733df0feab27 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:06.054574 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30999462-2c4c-4793-8cca-733df0feab27 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:06.192120 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-30999462-2c4c-4793-8cca-733df0feab27 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:06.203578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-30999462-2c4c-4793-8cca-733df0feab27 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:06.205072 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-30999462-2c4c-4793-8cca-733df0feab27 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:06.206246 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-30999462-2c4c-4793-8cca-733df0feab27 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1723 microversion: 2.20 time: 0.170623 Jun 23 17:24:06.206810 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 535/1051] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:06 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:07.224941 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a0f0c3e3-0cfb-4ed9-969f-0bfae67c5ec7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:07.225531 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a0f0c3e3-0cfb-4ed9-969f-0bfae67c5ec7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:07.232566 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0f0c3e3-0cfb-4ed9-969f-0bfae67c5ec7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:07.232986 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0f0c3e3-0cfb-4ed9-969f-0bfae67c5ec7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:07.233734 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0f0c3e3-0cfb-4ed9-969f-0bfae67c5ec7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:07.234194 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0f0c3e3-0cfb-4ed9-969f-0bfae67c5ec7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:07.372163 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a0f0c3e3-0cfb-4ed9-969f-0bfae67c5ec7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:07.385071 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a0f0c3e3-0cfb-4ed9-969f-0bfae67c5ec7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:07.386619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a0f0c3e3-0cfb-4ed9-969f-0bfae67c5ec7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:07.387783 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a0f0c3e3-0cfb-4ed9-969f-0bfae67c5ec7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1723 microversion: 2.20 time: 0.166970 Jun 23 17:24:07.388349 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 517/1052] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:07 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:07.730103 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e480838f-c237-455a-b40f-1ed7b04d6f58 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa693957-9537-474b-8ecd-0c82bc2a3371", "device": "/dev/sdb"}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:24:07.731732 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e480838f-c237-455a-b40f-1ed7b04d6f58 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:07.738847 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e480838f-c237-455a-b40f-1ed7b04d6f58 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:07.739314 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e480838f-c237-455a-b40f-1ed7b04d6f58 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:07.740041 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e480838f-c237-455a-b40f-1ed7b04d6f58 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:07.740476 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e480838f-c237-455a-b40f-1ed7b04d6f58 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:08.012143 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e480838f-c237-455a-b40f-1ed7b04d6f58 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "POST /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285639 Jun 23 17:24:08.012769 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 536/1053] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 23 17:24:07 2022] POST /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:24:08.236401 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-2ce0cfbf-7b07-4096-aa08-fed1d145771b req-4f8e2464-9a50-4587-b1c8-47942ffdbbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65320df8-ae02-4a62-bde7-14088815afcb", "name": "network-vif-deleted", "tag": "d460160b-555d-4087-b187-9075bf3d3b97"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:24:08.245280 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-2ce0cfbf-7b07-4096-aa08-fed1d145771b req-4f8e2464-9a50-4587-b1c8-47942ffdbbaf service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:08.245857 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-2ce0cfbf-7b07-4096-aa08-fed1d145771b req-4f8e2464-9a50-4587-b1c8-47942ffdbbaf service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:08.257166 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-2ce0cfbf-7b07-4096-aa08-fed1d145771b req-4f8e2464-9a50-4587-b1c8-47942ffdbbaf service nova] Creating event network-vif-deleted:d460160b-555d-4087-b187-9075bf3d3b97 for instance 65320df8-ae02-4a62-bde7-14088815afcb on hv-cinder-83538 Jun 23 17:24:08.262131 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-2ce0cfbf-7b07-4096-aa08-fed1d145771b req-4f8e2464-9a50-4587-b1c8-47942ffdbbaf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029333 Jun 23 17:24:08.262944 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 518/1054] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:24:08.409954 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-2b714209-8491-4352-b35b-2a61be2a53ff tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:08.410669 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-2b714209-8491-4352-b35b-2a61be2a53ff tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:08.419402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2b714209-8491-4352-b35b-2a61be2a53ff tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:08.420012 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2b714209-8491-4352-b35b-2a61be2a53ff tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:08.420746 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2b714209-8491-4352-b35b-2a61be2a53ff tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:08.421183 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2b714209-8491-4352-b35b-2a61be2a53ff tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:08.458215 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2b714209-8491-4352-b35b-2a61be2a53ff tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:08.458658 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2b714209-8491-4352-b35b-2a61be2a53ff tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:08.459158 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-2b714209-8491-4352-b35b-2a61be2a53ff tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lazy-loading 'fault' on Instance uuid 65320df8-ae02-4a62-bde7-14088815afcb {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:24:08.502173 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2b714209-8491-4352-b35b-2a61be2a53ff tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:08.510320 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2b714209-8491-4352-b35b-2a61be2a53ff tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:08.511831 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2b714209-8491-4352-b35b-2a61be2a53ff tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:08.513028 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-2b714209-8491-4352-b35b-2a61be2a53ff tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 200 len: 1372 microversion: 2.20 time: 0.109695 Jun 23 17:24:08.513665 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 537/1055] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:08 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:09.536836 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-dc64325b-1728-45ac-92b5-ee61c8675796 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:09.538020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-dc64325b-1728-45ac-92b5-ee61c8675796 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:09.550510 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dc64325b-1728-45ac-92b5-ee61c8675796 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:09.551821 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dc64325b-1728-45ac-92b5-ee61c8675796 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:09.553069 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dc64325b-1728-45ac-92b5-ee61c8675796 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:09.553898 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dc64325b-1728-45ac-92b5-ee61c8675796 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:09.571870 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-dc64325b-1728-45ac-92b5-ee61c8675796 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] HTTP exception thrown: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-dc64325b-1728-45ac-92b5-ee61c8675796 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Request method failure captured: Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb HTTP/1.1 Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitKDEhCPK9tkfoHLNMHQIRrqQPCKKYaJezXov2YfTbzWmyaYPrcKbmkKlwfJ7GySbnCTV3NhFoy6Iz93RK79PHDkYXIFn1ThqI4QnK6t9x1X2RwAe0RUS3Mc7a0UpX_zgAmDqWXfMD6__Bbgp3MOZ0I25bHPbKB-n3apP_ZgZkkJ9n18 Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: e2d73f7bfc184cacb49809a89563b585 Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:24:09.574555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:24:09.576487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e2d73f7bfc184cacb49809a89563b585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2d73f7bfc184cacb49809a89563b585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e2d73f7bfc184cacb49809a89563b585", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2d73f7bfc184cacb49809a89563b585"}]}] Jun 23 17:24:09.576487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:24:09.576487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: e2d73f7bfc184cacb49809a89563b585 Jun 23 17:24:09.576487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:24:09.576487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeShelveTestJSON-682111542-project Jun 23 17:24:09.576487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:24:09.576487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:24:09.576487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: 4b43fe7da444445fbffb6158d332d99d Jun 23 17:24:09.576487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeShelveTestJSON-682111542-project Jun 23 17:24:09.576487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:24:09.576487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:24:09.576487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '65320df8-ae02-4a62-bde7-14088815afcb'} Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:24:09.577675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:24:09.579824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:09.581316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-dc64325b-1728-45ac-92b5-ee61c8675796 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Returning 404 to user: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:24:09.581316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-dc64325b-1728-45ac-92b5-ee61c8675796 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 404 len: 111 microversion: 2.20 time: 0.048044 Jun 23 17:24:09.581316 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 519/1056] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:09 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 17:24:09.586917 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4df32cb3-5146-4f08-aa9c-e0e9465bf139 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '.version_select at 0x7f342da0fd30>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:09.611576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4df32cb3-5146-4f08-aa9c-e0e9465bf139 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1510774818" status: 204 len: 0 microversion: 2.20 time: 0.028571 Jun 23 17:24:09.612177 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 538/1057] 10.222.0.18 () {60 vars in 1261 bytes} [Thu Jun 23 17:24:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1510774818 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 23 17:24:10.246528 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e364f168-0cec-4933-95ae-bbca7e4f4148 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Action: 'create', calling method: .version_select at 0x7f34322cdd30>, body: {"keypair": {"name": "tempest-keypair-1941021983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaXkOu0xpHg6Ctbk1LX3ptqHJoPK4IERZlEUQHY1IGdazzDIXI8DgWAzYdO2WUNPaMxKf5BBUAagbBl/OzAWubJ0k1jdrXJeFVVVObgw7UIwjPS5W47MQYcSPGiaxpsDw=="}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:24:10.261522 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-e364f168-0cec-4933-95ae-bbca7e4f4148 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Getting quotas for project e2d73f7bfc184cacb49809a89563b585. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:24:10.265910 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-e364f168-0cec-4933-95ae-bbca7e4f4148 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Getting quotas for user 4b43fe7da444445fbffb6158d332d99d and project e2d73f7bfc184cacb49809a89563b585. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:24:10.291197 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e364f168-0cec-4933-95ae-bbca7e4f4148 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048613 Jun 23 17:24:10.291845 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 520/1058] 10.222.0.18 () {62 vars in 1199 bytes} [Thu Jun 23 17:24:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 17:24:11.655825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-912320098", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d11fc20-78b8-4593-ad26-eda404da60a9"}], "security_groups": [{"name": "tempest-securitygroup--80974825"}], "key_name": "tempest-keypair-1941021983", "user_data": "}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:24:11.767243 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.network.neutron [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] validate_networks() for [('1d11fc20-78b8-4593-ad26-eda404da60a9', None, None, None, None, None)] {{(pid=117897) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:24:12.166346 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Flavor limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:24:12.166778 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Image limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:24:12.167249 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Flavor pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:24:12.167659 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Image pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:24:12.168066 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:24:12.178924 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:12.179369 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:12.180169 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:12.180604 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:12.198631 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Getting quotas for project e2d73f7bfc184cacb49809a89563b585. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:24:12.203879 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Getting quotas for user 4b43fe7da444445fbffb6158d332d99d and project e2d73f7bfc184cacb49809a89563b585. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:24:12.215095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Going to run 1 instances... {{(pid=117897) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:24:12.217834 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:24:12.268128 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a864ee3e-83f8-4312-8c64-1b172cb62f22 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.617101 Jun 23 17:24:12.273557 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 539/1059] 10.222.0.18 () {62 vars in 1187 bytes} [Thu Jun 23 17:24:11 2022] POST /compute/v2.1/servers => generated 400 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 17:24:12.279600 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-421fdb93-895b-42be-a468-a8e2e0efa33f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:12.280264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-421fdb93-895b-42be-a468-a8e2e0efa33f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:12.337364 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-421fdb93-895b-42be-a468-a8e2e0efa33f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:12.345621 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-421fdb93-895b-42be-a468-a8e2e0efa33f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:12.347202 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-421fdb93-895b-42be-a468-a8e2e0efa33f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:12.348299 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-421fdb93-895b-42be-a468-a8e2e0efa33f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1281 microversion: 2.20 time: 0.073322 Jun 23 17:24:12.349064 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 521/1060] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:12 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:13.366784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a61b9214-5fb2-4faa-847a-855ad3d8cc57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:13.368103 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a61b9214-5fb2-4faa-847a-855ad3d8cc57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:13.374715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a61b9214-5fb2-4faa-847a-855ad3d8cc57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:13.375191 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a61b9214-5fb2-4faa-847a-855ad3d8cc57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:13.376043 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a61b9214-5fb2-4faa-847a-855ad3d8cc57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:13.376478 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a61b9214-5fb2-4faa-847a-855ad3d8cc57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:13.440439 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a61b9214-5fb2-4faa-847a-855ad3d8cc57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:13.449146 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a61b9214-5fb2-4faa-847a-855ad3d8cc57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:13.451014 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a61b9214-5fb2-4faa-847a-855ad3d8cc57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:13.452246 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a61b9214-5fb2-4faa-847a-855ad3d8cc57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1341 microversion: 2.20 time: 0.090168 Jun 23 17:24:13.453081 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 540/1061] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:13 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1341 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:14.471050 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-694bd5fe-83d4-4777-ab59-f60747c561ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:14.471702 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-694bd5fe-83d4-4777-ab59-f60747c561ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:14.478733 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-694bd5fe-83d4-4777-ab59-f60747c561ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:14.479183 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-694bd5fe-83d4-4777-ab59-f60747c561ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:14.479974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-694bd5fe-83d4-4777-ab59-f60747c561ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:14.480405 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-694bd5fe-83d4-4777-ab59-f60747c561ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:14.993278 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-694bd5fe-83d4-4777-ab59-f60747c561ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:15.004644 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-694bd5fe-83d4-4777-ab59-f60747c561ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:15.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-694bd5fe-83d4-4777-ab59-f60747c561ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:15.007422 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-694bd5fe-83d4-4777-ab59-f60747c561ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.540527 Jun 23 17:24:15.008095 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 522/1062] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:14 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:15.365280 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-e7e31da6-127a-424a-8c4a-8e5855e7e32d req-e3ec42bf-23ea-4ea5-80d4-dfbe609a505d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119e78bd-a2a6-47e7-a670-9c7e6c50af78", "tag": "42adbc70-d4e6-4f72-a374-033d3188ff7e"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:24:15.375929 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-e7e31da6-127a-424a-8c4a-8e5855e7e32d req-e3ec42bf-23ea-4ea5-80d4-dfbe609a505d service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:15.376592 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-e7e31da6-127a-424a-8c4a-8e5855e7e32d req-e3ec42bf-23ea-4ea5-80d4-dfbe609a505d service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:15.388937 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-e7e31da6-127a-424a-8c4a-8e5855e7e32d req-e3ec42bf-23ea-4ea5-80d4-dfbe609a505d service nova] Creating event network-changed:42adbc70-d4e6-4f72-a374-033d3188ff7e for instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 on hv-cinder-83538 Jun 23 17:24:15.394252 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-e7e31da6-127a-424a-8c4a-8e5855e7e32d req-e3ec42bf-23ea-4ea5-80d4-dfbe609a505d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034105 Jun 23 17:24:15.394864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 541/1063] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:24:16.030971 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1b467be4-5329-4409-8d31-675935186598 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:16.032037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1b467be4-5329-4409-8d31-675935186598 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:16.043358 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1b467be4-5329-4409-8d31-675935186598 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:16.044084 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1b467be4-5329-4409-8d31-675935186598 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:16.045364 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1b467be4-5329-4409-8d31-675935186598 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:16.046149 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1b467be4-5329-4409-8d31-675935186598 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:16.191788 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1b467be4-5329-4409-8d31-675935186598 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:16.200365 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1b467be4-5329-4409-8d31-675935186598 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:16.201861 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1b467be4-5329-4409-8d31-675935186598 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:16.202986 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1b467be4-5329-4409-8d31-675935186598 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.178636 Jun 23 17:24:16.203952 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 523/1064] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:16 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:17.222247 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-27dcc292-32d8-4218-9e3a-e3b1b2782d6d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:17.222929 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-27dcc292-32d8-4218-9e3a-e3b1b2782d6d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:17.229762 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-27dcc292-32d8-4218-9e3a-e3b1b2782d6d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:17.230214 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-27dcc292-32d8-4218-9e3a-e3b1b2782d6d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:17.231010 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-27dcc292-32d8-4218-9e3a-e3b1b2782d6d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:17.231440 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-27dcc292-32d8-4218-9e3a-e3b1b2782d6d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:17.449002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-27dcc292-32d8-4218-9e3a-e3b1b2782d6d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:17.457875 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-27dcc292-32d8-4218-9e3a-e3b1b2782d6d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:17.459414 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-27dcc292-32d8-4218-9e3a-e3b1b2782d6d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:17.460558 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-27dcc292-32d8-4218-9e3a-e3b1b2782d6d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.243507 Jun 23 17:24:17.461123 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 542/1065] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:17 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:17.860585 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-471e0217-a6d8-4f21-964f-f5aad4798fc1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:17.861184 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-471e0217-a6d8-4f21-964f-f5aad4798fc1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:17.874271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-471e0217-a6d8-4f21-964f-f5aad4798fc1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:17.874719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-471e0217-a6d8-4f21-964f-f5aad4798fc1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:17.875496 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-471e0217-a6d8-4f21-964f-f5aad4798fc1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:17.875920 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-471e0217-a6d8-4f21-964f-f5aad4798fc1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:17.903797 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-471e0217-a6d8-4f21-964f-f5aad4798fc1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:24:17.932019 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-2948d4a0-8be7-4178-8a57-67c5c3f4fa3b req-03ef436a-8078-4e89-a2ee-a7a66e419faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f24bd8-8c9f-442b-9c7b-41072c3a09fe", "tag": "17209ab7-6d94-4aed-96b3-e29955c001aa"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:24:17.943271 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-2948d4a0-8be7-4178-8a57-67c5c3f4fa3b req-03ef436a-8078-4e89-a2ee-a7a66e419faf service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:17.943933 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-2948d4a0-8be7-4178-8a57-67c5c3f4fa3b req-03ef436a-8078-4e89-a2ee-a7a66e419faf service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:17.957004 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-2948d4a0-8be7-4178-8a57-67c5c3f4fa3b req-03ef436a-8078-4e89-a2ee-a7a66e419faf service nova] Creating event network-changed:17209ab7-6d94-4aed-96b3-e29955c001aa for instance 11f24bd8-8c9f-442b-9c7b-41072c3a09fe on hv-cinder-83538 Jun 23 17:24:17.962839 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-2948d4a0-8be7-4178-8a57-67c5c3f4fa3b req-03ef436a-8078-4e89-a2ee-a7a66e419faf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098394 Jun 23 17:24:17.963975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 543/1066] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:24:17.988811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-471e0217-a6d8-4f21-964f-f5aad4798fc1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "DELETE /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 204 len: 0 microversion: 2.1 time: 0.131964 Jun 23 17:24:17.989494 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 524/1067] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:24:17 2022] DELETE /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:24:17.998531 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d8447ee4-c5a3-4eae-9742-f50b67364157 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:17.999374 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d8447ee4-c5a3-4eae-9742-f50b67364157 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:18.005865 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d8447ee4-c5a3-4eae-9742-f50b67364157 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:18.006319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d8447ee4-c5a3-4eae-9742-f50b67364157 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:18.007077 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d8447ee4-c5a3-4eae-9742-f50b67364157 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:18.007507 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d8447ee4-c5a3-4eae-9742-f50b67364157 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:18.139478 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d8447ee4-c5a3-4eae-9742-f50b67364157 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:18.147818 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d8447ee4-c5a3-4eae-9742-f50b67364157 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1575 microversion: 2.1 time: 0.153569 Jun 23 17:24:18.157442 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 544/1068] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:17 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:18.479721 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e0c60698-662a-4ede-9325-ef798c7890a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:18.480417 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e0c60698-662a-4ede-9325-ef798c7890a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:18.488018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0c60698-662a-4ede-9325-ef798c7890a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:18.488722 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0c60698-662a-4ede-9325-ef798c7890a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:18.489605 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0c60698-662a-4ede-9325-ef798c7890a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:18.490077 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0c60698-662a-4ede-9325-ef798c7890a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:18.631393 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e0c60698-662a-4ede-9325-ef798c7890a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:18.640218 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e0c60698-662a-4ede-9325-ef798c7890a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:18.641695 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e0c60698-662a-4ede-9325-ef798c7890a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:18.642879 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e0c60698-662a-4ede-9325-ef798c7890a3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.167655 Jun 23 17:24:18.643827 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 525/1069] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:18 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:19.168963 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a4b4abb2-e256-44b4-b4f5-999a7095da90 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:19.170011 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a4b4abb2-e256-44b4-b4f5-999a7095da90 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:19.181894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a4b4abb2-e256-44b4-b4f5-999a7095da90 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:19.182605 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a4b4abb2-e256-44b4-b4f5-999a7095da90 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:19.183850 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a4b4abb2-e256-44b4-b4f5-999a7095da90 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:19.184560 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a4b4abb2-e256-44b4-b4f5-999a7095da90 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:19.324702 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a4b4abb2-e256-44b4-b4f5-999a7095da90 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:19.336482 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a4b4abb2-e256-44b4-b4f5-999a7095da90 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1575 microversion: 2.1 time: 0.173965 Jun 23 17:24:19.337236 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 545/1070] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:19 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:19.663909 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8e0e3e8f-c3c3-4590-b298-534c216c77b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:19.664539 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8e0e3e8f-c3c3-4590-b298-534c216c77b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:19.675065 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e0e3e8f-c3c3-4590-b298-534c216c77b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:19.675611 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e0e3e8f-c3c3-4590-b298-534c216c77b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:19.676382 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e0e3e8f-c3c3-4590-b298-534c216c77b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:19.676850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e0e3e8f-c3c3-4590-b298-534c216c77b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:19.829180 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8e0e3e8f-c3c3-4590-b298-534c216c77b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:19.837961 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8e0e3e8f-c3c3-4590-b298-534c216c77b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:19.839483 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8e0e3e8f-c3c3-4590-b298-534c216c77b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:19.840588 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8e0e3e8f-c3c3-4590-b298-534c216c77b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.182876 Jun 23 17:24:19.841156 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 526/1071] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:19 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:20.361982 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-71094a2c-ed65-43c4-a520-d211e7e0dc30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:20.362926 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-71094a2c-ed65-43c4-a520-d211e7e0dc30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:20.369912 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71094a2c-ed65-43c4-a520-d211e7e0dc30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:20.370363 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71094a2c-ed65-43c4-a520-d211e7e0dc30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:20.371121 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71094a2c-ed65-43c4-a520-d211e7e0dc30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:20.371552 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-71094a2c-ed65-43c4-a520-d211e7e0dc30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:20.502038 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-71094a2c-ed65-43c4-a520-d211e7e0dc30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:20.510240 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-71094a2c-ed65-43c4-a520-d211e7e0dc30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1575 microversion: 2.1 time: 0.154716 Jun 23 17:24:20.510825 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 546/1072] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:20 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:20.862947 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2da3df3b-50ee-4111-a92c-29e48e0aec57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:20.863969 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2da3df3b-50ee-4111-a92c-29e48e0aec57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:20.875702 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2da3df3b-50ee-4111-a92c-29e48e0aec57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:20.875919 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2da3df3b-50ee-4111-a92c-29e48e0aec57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:20.877035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2da3df3b-50ee-4111-a92c-29e48e0aec57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:20.877776 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2da3df3b-50ee-4111-a92c-29e48e0aec57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:21.010205 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2da3df3b-50ee-4111-a92c-29e48e0aec57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:21.021042 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2da3df3b-50ee-4111-a92c-29e48e0aec57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:21.022597 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2da3df3b-50ee-4111-a92c-29e48e0aec57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:21.023740 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2da3df3b-50ee-4111-a92c-29e48e0aec57 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.167464 Jun 23 17:24:21.024253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 527/1073] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:20 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:21.531256 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-2f6277ed-fb61-4cbb-b113-a63544b9589c tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:21.532192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-2f6277ed-fb61-4cbb-b113-a63544b9589c tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:21.540553 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2f6277ed-fb61-4cbb-b113-a63544b9589c tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:21.541005 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2f6277ed-fb61-4cbb-b113-a63544b9589c tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:21.541763 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2f6277ed-fb61-4cbb-b113-a63544b9589c tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:21.542228 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2f6277ed-fb61-4cbb-b113-a63544b9589c tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:21.561915 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:21.694325 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2f6277ed-fb61-4cbb-b113-a63544b9589c tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:21.705242 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-2f6277ed-fb61-4cbb-b113-a63544b9589c tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1575 microversion: 2.1 time: 0.180220 Jun 23 17:24:21.706066 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 547/1074] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:21 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:22.042121 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f5657cbd-4d9f-4c31-9b02-ecf090a6370f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:22.042839 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f5657cbd-4d9f-4c31-9b02-ecf090a6370f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:22.049449 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f5657cbd-4d9f-4c31-9b02-ecf090a6370f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:22.049903 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f5657cbd-4d9f-4c31-9b02-ecf090a6370f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:22.051254 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f5657cbd-4d9f-4c31-9b02-ecf090a6370f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:22.051682 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f5657cbd-4d9f-4c31-9b02-ecf090a6370f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:22.194076 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f5657cbd-4d9f-4c31-9b02-ecf090a6370f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:22.202288 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f5657cbd-4d9f-4c31-9b02-ecf090a6370f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:22.203801 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f5657cbd-4d9f-4c31-9b02-ecf090a6370f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:22.204915 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f5657cbd-4d9f-4c31-9b02-ecf090a6370f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.166845 Jun 23 17:24:22.205475 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 528/1075] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:22 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:22.726936 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7a8f5fc0-5f65-4340-a0da-72347281a413 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:22.727601 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7a8f5fc0-5f65-4340-a0da-72347281a413 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:22.729476 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=2 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:22.730309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=6 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:22.736915 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7a8f5fc0-5f65-4340-a0da-72347281a413 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:22.737367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7a8f5fc0-5f65-4340-a0da-72347281a413 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:22.738226 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7a8f5fc0-5f65-4340-a0da-72347281a413 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:22.738681 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7a8f5fc0-5f65-4340-a0da-72347281a413 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:22.871727 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7a8f5fc0-5f65-4340-a0da-72347281a413 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:22.879482 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7a8f5fc0-5f65-4340-a0da-72347281a413 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1575 microversion: 2.1 time: 0.156819 Jun 23 17:24:22.880060 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 548/1076] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:22 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:23.224557 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6380c274-4d70-44b1-a818-60ad3de6853f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:23.225156 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6380c274-4d70-44b1-a818-60ad3de6853f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:23.227239 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:23.234409 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6380c274-4d70-44b1-a818-60ad3de6853f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:23.234876 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6380c274-4d70-44b1-a818-60ad3de6853f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:23.235644 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6380c274-4d70-44b1-a818-60ad3de6853f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:23.236076 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6380c274-4d70-44b1-a818-60ad3de6853f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:23.379240 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6380c274-4d70-44b1-a818-60ad3de6853f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:23.387676 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6380c274-4d70-44b1-a818-60ad3de6853f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:23.389181 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6380c274-4d70-44b1-a818-60ad3de6853f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:23.390317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6380c274-4d70-44b1-a818-60ad3de6853f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.169949 Jun 23 17:24:23.390877 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 529/1077] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:23 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:23.900913 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6ccd9e10-933f-43c4-a6a2-d2fdfc93f0f6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:23.901964 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6ccd9e10-933f-43c4-a6a2-d2fdfc93f0f6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:23.912112 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6ccd9e10-933f-43c4-a6a2-d2fdfc93f0f6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:23.912574 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6ccd9e10-933f-43c4-a6a2-d2fdfc93f0f6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:23.913343 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6ccd9e10-933f-43c4-a6a2-d2fdfc93f0f6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:23.913786 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6ccd9e10-933f-43c4-a6a2-d2fdfc93f0f6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:24.060162 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6ccd9e10-933f-43c4-a6a2-d2fdfc93f0f6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:24.068491 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6ccd9e10-933f-43c4-a6a2-d2fdfc93f0f6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1575 microversion: 2.1 time: 0.174382 Jun 23 17:24:24.069068 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 549/1078] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:23 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:24.413461 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e51d2c52-61ff-46b9-9b06-ffd0bffaf987 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:24.414425 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e51d2c52-61ff-46b9-9b06-ffd0bffaf987 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:24.425969 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e51d2c52-61ff-46b9-9b06-ffd0bffaf987 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:24.426727 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e51d2c52-61ff-46b9-9b06-ffd0bffaf987 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:24.428035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e51d2c52-61ff-46b9-9b06-ffd0bffaf987 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:24.428764 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e51d2c52-61ff-46b9-9b06-ffd0bffaf987 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:24.573486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e51d2c52-61ff-46b9-9b06-ffd0bffaf987 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:24.585783 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e51d2c52-61ff-46b9-9b06-ffd0bffaf987 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:24.588240 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e51d2c52-61ff-46b9-9b06-ffd0bffaf987 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:24.590044 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e51d2c52-61ff-46b9-9b06-ffd0bffaf987 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.183298 Jun 23 17:24:24.590836 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 530/1079] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:24 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:25.089980 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9af916c4-4c33-44f9-84d8-da50e24c8e51 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:25.090958 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9af916c4-4c33-44f9-84d8-da50e24c8e51 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:25.100421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9af916c4-4c33-44f9-84d8-da50e24c8e51 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:25.100871 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9af916c4-4c33-44f9-84d8-da50e24c8e51 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:25.101626 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9af916c4-4c33-44f9-84d8-da50e24c8e51 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:25.102096 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9af916c4-4c33-44f9-84d8-da50e24c8e51 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:25.249543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9af916c4-4c33-44f9-84d8-da50e24c8e51 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:25.258015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9af916c4-4c33-44f9-84d8-da50e24c8e51 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1575 microversion: 2.1 time: 0.174560 Jun 23 17:24:25.258605 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 550/1080] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:25 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:25.614870 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-25152410-fec8-4fdd-8a69-83055219ee11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:25.615625 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-25152410-fec8-4fdd-8a69-83055219ee11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:25.626525 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-25152410-fec8-4fdd-8a69-83055219ee11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:25.627396 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-25152410-fec8-4fdd-8a69-83055219ee11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:25.629018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-25152410-fec8-4fdd-8a69-83055219ee11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:25.630096 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-25152410-fec8-4fdd-8a69-83055219ee11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:25.638747 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:25.778876 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-25152410-fec8-4fdd-8a69-83055219ee11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:25.787412 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-25152410-fec8-4fdd-8a69-83055219ee11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:25.789020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-25152410-fec8-4fdd-8a69-83055219ee11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:25.790165 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-25152410-fec8-4fdd-8a69-83055219ee11 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.181639 Jun 23 17:24:25.790747 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 531/1081] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:25 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:26.281425 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5f3300fa-a272-49a9-b476-0b12744cc61e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:26.282597 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5f3300fa-a272-49a9-b476-0b12744cc61e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:26.293722 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5f3300fa-a272-49a9-b476-0b12744cc61e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:26.294501 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5f3300fa-a272-49a9-b476-0b12744cc61e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:26.295787 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5f3300fa-a272-49a9-b476-0b12744cc61e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:26.296508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5f3300fa-a272-49a9-b476-0b12744cc61e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:26.478034 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5f3300fa-a272-49a9-b476-0b12744cc61e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:26.485715 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5f3300fa-a272-49a9-b476-0b12744cc61e tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1575 microversion: 2.1 time: 0.210831 Jun 23 17:24:26.486277 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 551/1082] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:26 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:26.814321 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-de2e9893-0045-4158-a32c-48e50fb6f3d6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:26.814923 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-de2e9893-0045-4158-a32c-48e50fb6f3d6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:26.821380 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de2e9893-0045-4158-a32c-48e50fb6f3d6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:26.822206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de2e9893-0045-4158-a32c-48e50fb6f3d6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:26.823128 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de2e9893-0045-4158-a32c-48e50fb6f3d6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:26.823630 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de2e9893-0045-4158-a32c-48e50fb6f3d6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:27.105527 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-de2e9893-0045-4158-a32c-48e50fb6f3d6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:27.116782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-de2e9893-0045-4158-a32c-48e50fb6f3d6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:27.119497 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-de2e9893-0045-4158-a32c-48e50fb6f3d6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:27.120621 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-de2e9893-0045-4158-a32c-48e50fb6f3d6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.311905 Jun 23 17:24:27.121411 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 532/1083] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:26 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:27.502662 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d79385c0-30f7-42cc-a33b-5acd8bcc4c9d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:27.503420 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d79385c0-30f7-42cc-a33b-5acd8bcc4c9d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:27.510833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d79385c0-30f7-42cc-a33b-5acd8bcc4c9d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:27.511428 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d79385c0-30f7-42cc-a33b-5acd8bcc4c9d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:27.512206 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d79385c0-30f7-42cc-a33b-5acd8bcc4c9d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:27.512740 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d79385c0-30f7-42cc-a33b-5acd8bcc4c9d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:27.654877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d79385c0-30f7-42cc-a33b-5acd8bcc4c9d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:27.663509 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d79385c0-30f7-42cc-a33b-5acd8bcc4c9d tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1458 microversion: 2.1 time: 0.165031 Jun 23 17:24:27.664091 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 552/1084] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:27 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1458 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:28.139665 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-44c7432e-dce8-43d9-b1a5-cfbd71387a13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:28.140205 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-44c7432e-dce8-43d9-b1a5-cfbd71387a13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:28.147139 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44c7432e-dce8-43d9-b1a5-cfbd71387a13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:28.147590 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44c7432e-dce8-43d9-b1a5-cfbd71387a13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:28.148367 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44c7432e-dce8-43d9-b1a5-cfbd71387a13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:28.148806 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44c7432e-dce8-43d9-b1a5-cfbd71387a13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:28.287378 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-a897b708-61e8-4101-9c78-c3733ba5f9f3 req-74003597-d2b0-4f84-aa50-e0d49cbed4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f24bd8-8c9f-442b-9c7b-41072c3a09fe", "name": "network-vif-deleted", "tag": "17209ab7-6d94-4aed-96b3-e29955c001aa"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:24:28.299888 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-a897b708-61e8-4101-9c78-c3733ba5f9f3 req-74003597-d2b0-4f84-aa50-e0d49cbed4ea service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:28.300377 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-a897b708-61e8-4101-9c78-c3733ba5f9f3 req-74003597-d2b0-4f84-aa50-e0d49cbed4ea service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:28.312475 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-a897b708-61e8-4101-9c78-c3733ba5f9f3 req-74003597-d2b0-4f84-aa50-e0d49cbed4ea service nova] Creating event network-vif-deleted:17209ab7-6d94-4aed-96b3-e29955c001aa for instance 11f24bd8-8c9f-442b-9c7b-41072c3a09fe on hv-cinder-83538 Jun 23 17:24:28.317816 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-a897b708-61e8-4101-9c78-c3733ba5f9f3 req-74003597-d2b0-4f84-aa50-e0d49cbed4ea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034370 Jun 23 17:24:28.318421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 553/1085] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:24:28.338125 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-44c7432e-dce8-43d9-b1a5-cfbd71387a13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:28.346109 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-44c7432e-dce8-43d9-b1a5-cfbd71387a13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:28.347920 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-44c7432e-dce8-43d9-b1a5-cfbd71387a13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:28.349020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-44c7432e-dce8-43d9-b1a5-cfbd71387a13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.213448 Jun 23 17:24:28.349570 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 533/1086] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:28 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:28.682755 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-2df1c260-be82-4309-b7a9-d8039254bc46 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:28.683517 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-2df1c260-be82-4309-b7a9-d8039254bc46 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:28.690384 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2df1c260-be82-4309-b7a9-d8039254bc46 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:28.690826 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2df1c260-be82-4309-b7a9-d8039254bc46 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:28.691652 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2df1c260-be82-4309-b7a9-d8039254bc46 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:28.692109 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2df1c260-be82-4309-b7a9-d8039254bc46 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:28.754182 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2df1c260-be82-4309-b7a9-d8039254bc46 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:28.761957 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-2df1c260-be82-4309-b7a9-d8039254bc46 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1390 microversion: 2.1 time: 0.084369 Jun 23 17:24:28.762524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 554/1087] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:28 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:29.371862 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ea60d21f-0950-45c7-aad2-38856c45ae94 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:29.372742 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ea60d21f-0950-45c7-aad2-38856c45ae94 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:29.384236 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ea60d21f-0950-45c7-aad2-38856c45ae94 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:29.384975 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ea60d21f-0950-45c7-aad2-38856c45ae94 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:29.386278 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ea60d21f-0950-45c7-aad2-38856c45ae94 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:29.386990 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ea60d21f-0950-45c7-aad2-38856c45ae94 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:29.520594 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ea60d21f-0950-45c7-aad2-38856c45ae94 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:29.529056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ea60d21f-0950-45c7-aad2-38856c45ae94 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:29.530585 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ea60d21f-0950-45c7-aad2-38856c45ae94 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:29.531691 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ea60d21f-0950-45c7-aad2-38856c45ae94 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.166581 Jun 23 17:24:29.532506 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 534/1088] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:29 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:29.783614 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b99900e0-fda3-4993-8c4b-cbae44755a94 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:29.784665 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b99900e0-fda3-4993-8c4b-cbae44755a94 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:29.791982 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b99900e0-fda3-4993-8c4b-cbae44755a94 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:29.792425 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b99900e0-fda3-4993-8c4b-cbae44755a94 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:29.793151 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b99900e0-fda3-4993-8c4b-cbae44755a94 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:29.793614 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b99900e0-fda3-4993-8c4b-cbae44755a94 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:29.854948 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b99900e0-fda3-4993-8c4b-cbae44755a94 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:29.862802 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b99900e0-fda3-4993-8c4b-cbae44755a94 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1225 microversion: 2.1 time: 0.085872 Jun 23 17:24:29.863402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 555/1089] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:29 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:30.554173 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-10f9ff7e-7546-407e-a9e4-188b09a424e0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:30.555191 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-10f9ff7e-7546-407e-a9e4-188b09a424e0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:30.566736 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-10f9ff7e-7546-407e-a9e4-188b09a424e0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:30.567489 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-10f9ff7e-7546-407e-a9e4-188b09a424e0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:30.568869 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-10f9ff7e-7546-407e-a9e4-188b09a424e0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:30.569301 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-10f9ff7e-7546-407e-a9e4-188b09a424e0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:30.722995 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-10f9ff7e-7546-407e-a9e4-188b09a424e0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:30.735753 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-10f9ff7e-7546-407e-a9e4-188b09a424e0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:30.738119 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-10f9ff7e-7546-407e-a9e4-188b09a424e0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:30.739763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-10f9ff7e-7546-407e-a9e4-188b09a424e0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.192339 Jun 23 17:24:30.740443 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 535/1090] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:30 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:30.883752 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-195019f3-569d-4376-aac0-fc9deaf15131 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:30.884580 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-195019f3-569d-4376-aac0-fc9deaf15131 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:30.895659 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-195019f3-569d-4376-aac0-fc9deaf15131 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:30.896830 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-195019f3-569d-4376-aac0-fc9deaf15131 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:30.897426 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-195019f3-569d-4376-aac0-fc9deaf15131 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:30.897895 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-195019f3-569d-4376-aac0-fc9deaf15131 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:30.959293 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-195019f3-569d-4376-aac0-fc9deaf15131 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:30.967042 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-195019f3-569d-4376-aac0-fc9deaf15131 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1225 microversion: 2.1 time: 0.090049 Jun 23 17:24:30.967611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 556/1091] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:30 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:31.762777 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7c226ad4-e975-44e6-8cd5-cb611b6c3082 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:31.763800 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7c226ad4-e975-44e6-8cd5-cb611b6c3082 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:31.773851 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7c226ad4-e975-44e6-8cd5-cb611b6c3082 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:31.774332 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7c226ad4-e975-44e6-8cd5-cb611b6c3082 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:31.775087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7c226ad4-e975-44e6-8cd5-cb611b6c3082 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:31.775522 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7c226ad4-e975-44e6-8cd5-cb611b6c3082 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:31.912055 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7c226ad4-e975-44e6-8cd5-cb611b6c3082 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:31.920138 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7c226ad4-e975-44e6-8cd5-cb611b6c3082 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:31.921611 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7c226ad4-e975-44e6-8cd5-cb611b6c3082 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:31.922728 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7c226ad4-e975-44e6-8cd5-cb611b6c3082 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.167101 Jun 23 17:24:31.923285 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 536/1092] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:31 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:31.988160 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-27db3e47-9f5c-4355-8453-a568e9c9d974 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:31.989157 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-27db3e47-9f5c-4355-8453-a568e9c9d974 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:32.000040 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-27db3e47-9f5c-4355-8453-a568e9c9d974 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:32.000786 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-27db3e47-9f5c-4355-8453-a568e9c9d974 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:32.002081 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-27db3e47-9f5c-4355-8453-a568e9c9d974 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:32.002802 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-27db3e47-9f5c-4355-8453-a568e9c9d974 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:32.077144 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-27db3e47-9f5c-4355-8453-a568e9c9d974 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:32.085648 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-27db3e47-9f5c-4355-8453-a568e9c9d974 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1225 microversion: 2.1 time: 0.104174 Jun 23 17:24:32.086255 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 557/1093] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:31 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:32.941595 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0f726411-cd22-4963-95bc-b10c14ad2dce tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:32.942193 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0f726411-cd22-4963-95bc-b10c14ad2dce tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:32.944566 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:32.950793 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0f726411-cd22-4963-95bc-b10c14ad2dce tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:32.951267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0f726411-cd22-4963-95bc-b10c14ad2dce tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:32.952070 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0f726411-cd22-4963-95bc-b10c14ad2dce tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:32.952713 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0f726411-cd22-4963-95bc-b10c14ad2dce tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:33.079946 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-3e3ed954-fe3f-4231-a51c-2970a92e7f61 req-2d9a4bf6-92ea-408b-9fb8-822ad3af8701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119e78bd-a2a6-47e7-a670-9c7e6c50af78", "name": "network-vif-plugged", "status": "completed", "tag": "42adbc70-d4e6-4f72-a374-033d3188ff7e"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:24:33.085233 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:33.090477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-3e3ed954-fe3f-4231-a51c-2970a92e7f61 req-2d9a4bf6-92ea-408b-9fb8-822ad3af8701 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:33.091508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-3e3ed954-fe3f-4231-a51c-2970a92e7f61 req-2d9a4bf6-92ea-408b-9fb8-822ad3af8701 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:33.097044 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0f726411-cd22-4963-95bc-b10c14ad2dce tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:33.106262 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0f726411-cd22-4963-95bc-b10c14ad2dce tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:33.107948 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0f726411-cd22-4963-95bc-b10c14ad2dce tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:33.109135 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0f726411-cd22-4963-95bc-b10c14ad2dce tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.171674 Jun 23 17:24:33.109765 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 537/1094] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:32 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:33.111833 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-3e3ed954-fe3f-4231-a51c-2970a92e7f61 req-2d9a4bf6-92ea-408b-9fb8-822ad3af8701 service nova] Creating event network-vif-plugged:42adbc70-d4e6-4f72-a374-033d3188ff7e for instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 on hv-cinder-83538 Jun 23 17:24:33.116963 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-3e3ed954-fe3f-4231-a51c-2970a92e7f61 req-2d9a4bf6-92ea-408b-9fb8-822ad3af8701 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098535 Jun 23 17:24:33.117544 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 558/1095] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:24:33.119547 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0bc2854a-53e3-41cc-a51c-78529d3464a6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:33.120271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0bc2854a-53e3-41cc-a51c-78529d3464a6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:33.126372 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bc2854a-53e3-41cc-a51c-78529d3464a6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:33.126790 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bc2854a-53e3-41cc-a51c-78529d3464a6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:33.127548 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bc2854a-53e3-41cc-a51c-78529d3464a6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:33.128005 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bc2854a-53e3-41cc-a51c-78529d3464a6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:33.157748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bc2854a-53e3-41cc-a51c-78529d3464a6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:33.158220 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bc2854a-53e3-41cc-a51c-78529d3464a6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:33.158655 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-0bc2854a-53e3-41cc-a51c-78529d3464a6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lazy-loading 'fault' on Instance uuid 11f24bd8-8c9f-442b-9c7b-41072c3a09fe {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:24:33.202339 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0bc2854a-53e3-41cc-a51c-78529d3464a6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:33.209922 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0bc2854a-53e3-41cc-a51c-78529d3464a6 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 200 len: 1230 microversion: 2.1 time: 0.095191 Jun 23 17:24:33.210487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 538/1096] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:33 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:34.127543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-970b538a-fea4-44be-ab69-db171900b62c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:34.128174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-970b538a-fea4-44be-ab69-db171900b62c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:34.135216 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-970b538a-fea4-44be-ab69-db171900b62c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:34.135654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-970b538a-fea4-44be-ab69-db171900b62c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:34.136553 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-970b538a-fea4-44be-ab69-db171900b62c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:34.137053 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-970b538a-fea4-44be-ab69-db171900b62c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:34.227036 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b9920b8d-7dca-4daa-8c98-42d67bed2b30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:34.227906 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b9920b8d-7dca-4daa-8c98-42d67bed2b30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 11f24bd8-8c9f-442b-9c7b-41072c3a09fe] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:34.235189 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9920b8d-7dca-4daa-8c98-42d67bed2b30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:34.235639 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9920b8d-7dca-4daa-8c98-42d67bed2b30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:34.236406 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9920b8d-7dca-4daa-8c98-42d67bed2b30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:34.236846 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9920b8d-7dca-4daa-8c98-42d67bed2b30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:34.251482 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-b9920b8d-7dca-4daa-8c98-42d67bed2b30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] HTTP exception thrown: Instance 11f24bd8-8c9f-442b-9c7b-41072c3a09fe could not be found. Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b9920b8d-7dca-4daa-8c98-42d67bed2b30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Request method failure captured: Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe HTTP/1.1 Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ-Z7KVHuHnfXlIDzhurTdoORYdnBzHAr5K0ur7EnGyKR6wQYakIQ2uL7npIPAmkACn9VYnkSubroH6VRhjui17QkxWDkJjnAdu83-3gecDXsf0Z6QKwJ5dJ1yd2WCbnd4Ty3dKLOGUxf3VFRz28vh_EMNU8Dd39unN-rIVaoddQb2o Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: e393091e3c2d42e79e9f2ec80d471faf Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-TestVolumeBootPattern-609773018 Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:24:34.253302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:24:34.254761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e393091e3c2d42e79e9f2ec80d471faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e393091e3c2d42e79e9f2ec80d471faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e393091e3c2d42e79e9f2ec80d471faf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e393091e3c2d42e79e9f2ec80d471faf"}]}] Jun 23 17:24:34.254761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-TestVolumeBootPattern-609773018 Jun 23 17:24:34.254761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: e393091e3c2d42e79e9f2ec80d471faf Jun 23 17:24:34.254761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-TestVolumeBootPattern-609773018 Jun 23 17:24:34.254761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-TestVolumeBootPattern-609773018-project Jun 23 17:24:34.254761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:24:34.254761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:24:34.254761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: d21524f4232648ebaed76e1d7d5daf5f Jun 23 17:24:34.254761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-TestVolumeBootPattern-609773018-project Jun 23 17:24:34.254761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:24:34.254761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 11f24bd8-8c9f-442b-9c7b-41072c3a09fe could not be found. Jun 23 17:24:34.254761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '11f24bd8-8c9f-442b-9c7b-41072c3a09fe'} Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11f24bd8-8c9f-442b-9c7b-41072c3a09fe could not be found. Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:24:34.255738 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11f24bd8-8c9f-442b-9c7b-41072c3a09fe could not be found. Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11f24bd8-8c9f-442b-9c7b-41072c3a09fe could not be found. Jun 23 17:24:34.257362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:34.258995 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b9920b8d-7dca-4daa-8c98-42d67bed2b30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Returning 404 to user: Instance 11f24bd8-8c9f-442b-9c7b-41072c3a09fe could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:24:34.258995 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b9920b8d-7dca-4daa-8c98-42d67bed2b30 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe" status: 404 len: 111 microversion: 2.1 time: 0.031656 Jun 23 17:24:34.258995 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 539/1097] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:34 2022] GET /compute/v2.1/servers/11f24bd8-8c9f-442b-9c7b-41072c3a09fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:24:34.274560 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-970b538a-fea4-44be-ab69-db171900b62c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:34.283011 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-970b538a-fea4-44be-ab69-db171900b62c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:34.284503 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-970b538a-fea4-44be-ab69-db171900b62c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:34.285605 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-970b538a-fea4-44be-ab69-db171900b62c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1405 microversion: 2.20 time: 0.162772 Jun 23 17:24:34.286232 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 559/1098] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:34 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:35.304616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6b96b7ea-2e79-44bb-a715-d14d861360db tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:35.305257 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6b96b7ea-2e79-44bb-a715-d14d861360db tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:35.312438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b96b7ea-2e79-44bb-a715-d14d861360db tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:35.312890 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b96b7ea-2e79-44bb-a715-d14d861360db tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:35.313648 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b96b7ea-2e79-44bb-a715-d14d861360db tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:35.314107 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b96b7ea-2e79-44bb-a715-d14d861360db tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:35.452428 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6b96b7ea-2e79-44bb-a715-d14d861360db tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:35.460787 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6b96b7ea-2e79-44bb-a715-d14d861360db tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:35.462845 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6b96b7ea-2e79-44bb-a715-d14d861360db tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:35.464037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6b96b7ea-2e79-44bb-a715-d14d861360db tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1597 microversion: 2.20 time: 0.163540 Jun 23 17:24:35.464583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 540/1099] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:24:35 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1597 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:24:35.481621 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-30a99148-a919-4e02-9898-e3e14940a1fb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:35.482217 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-30a99148-a919-4e02-9898-e3e14940a1fb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:35.489162 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30a99148-a919-4e02-9898-e3e14940a1fb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:35.489754 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30a99148-a919-4e02-9898-e3e14940a1fb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:35.490558 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30a99148-a919-4e02-9898-e3e14940a1fb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:35.491022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30a99148-a919-4e02-9898-e3e14940a1fb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:35.568250 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-30a99148-a919-4e02-9898-e3e14940a1fb tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090579 Jun 23 17:24:35.568847 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 560/1100] 10.222.0.18 () {60 vars in 1315 bytes} [Thu Jun 23 17:24:35 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 17:24:36.793097 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-37f9e087-a1c0-4f2a-a0b7-7483d486a3d5 req-35f1b2bb-708a-46e6-8cf1-f36726044842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119e78bd-a2a6-47e7-a670-9c7e6c50af78", "tag": "42adbc70-d4e6-4f72-a374-033d3188ff7e"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:24:36.803737 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-37f9e087-a1c0-4f2a-a0b7-7483d486a3d5 req-35f1b2bb-708a-46e6-8cf1-f36726044842 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:36.804482 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-37f9e087-a1c0-4f2a-a0b7-7483d486a3d5 req-35f1b2bb-708a-46e6-8cf1-f36726044842 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:36.818278 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-37f9e087-a1c0-4f2a-a0b7-7483d486a3d5 req-35f1b2bb-708a-46e6-8cf1-f36726044842 service nova] Creating event network-changed:42adbc70-d4e6-4f72-a374-033d3188ff7e for instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 on hv-cinder-83538 Jun 23 17:24:36.824554 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-37f9e087-a1c0-4f2a-a0b7-7483d486a3d5 req-35f1b2bb-708a-46e6-8cf1-f36726044842 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035374 Jun 23 17:24:36.825196 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 541/1101] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:24:37.079637 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-90c800e1-2ed2-43be-ad27-d69d5f937813 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:37.080894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-90c800e1-2ed2-43be-ad27-d69d5f937813 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:37.089114 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-90c800e1-2ed2-43be-ad27-d69d5f937813 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:37.089686 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-90c800e1-2ed2-43be-ad27-d69d5f937813 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:37.090589 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-90c800e1-2ed2-43be-ad27-d69d5f937813 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:37.091257 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-90c800e1-2ed2-43be-ad27-d69d5f937813 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:37.197022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-90c800e1-2ed2-43be-ad27-d69d5f937813 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lazy-loading 'services' on Instance uuid 95ad824e-0ca7-45df-b884-760e7612a09b {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:24:37.289534 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-90c800e1-2ed2-43be-ad27-d69d5f937813 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b/os-volume_attachments/fa693957-9537-474b-8ecd-0c82bc2a3371" status: 202 len: 0 microversion: 2.1 time: 0.214935 Jun 23 17:24:37.290473 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 561/1102] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 23 17:24:37 2022] DELETE /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b/os-volume_attachments/fa693957-9537-474b-8ecd-0c82bc2a3371 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:24:37.474114 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2426b9c9-092b-4aae-8ee5-48df745c6717 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:37.474960 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2426b9c9-092b-4aae-8ee5-48df745c6717 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:37.482672 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2426b9c9-092b-4aae-8ee5-48df745c6717 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:37.482864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-6561a242-fc1f-403a-b5ca-ce1b78a92d8a req-609dd29f-93a5-42a5-8775-8ca3ba26047b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6202caa7-6072-4d4f-adf6-9e6effa0cae3", "tag": "3da60010-d040-4053-a999-f4b58c9362b0"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:24:37.483533 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2426b9c9-092b-4aae-8ee5-48df745c6717 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:37.484542 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2426b9c9-092b-4aae-8ee5-48df745c6717 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:37.485175 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2426b9c9-092b-4aae-8ee5-48df745c6717 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:37.494763 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-6561a242-fc1f-403a-b5ca-ce1b78a92d8a req-609dd29f-93a5-42a5-8775-8ca3ba26047b service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:37.497590 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-6561a242-fc1f-403a-b5ca-ce1b78a92d8a req-609dd29f-93a5-42a5-8775-8ca3ba26047b service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:37.513826 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2426b9c9-092b-4aae-8ee5-48df745c6717 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:24:37.514161 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-6561a242-fc1f-403a-b5ca-ce1b78a92d8a req-609dd29f-93a5-42a5-8775-8ca3ba26047b service nova] Creating event network-changed:3da60010-d040-4053-a999-f4b58c9362b0 for instance 6202caa7-6072-4d4f-adf6-9e6effa0cae3 on hv-cinder-83538 Jun 23 17:24:37.520574 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-6561a242-fc1f-403a-b5ca-ce1b78a92d8a req-609dd29f-93a5-42a5-8775-8ca3ba26047b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043734 Jun 23 17:24:37.521543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 562/1103] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:24:37.601239 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2426b9c9-092b-4aae-8ee5-48df745c6717 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 204 len: 0 microversion: 2.1 time: 0.131101 Jun 23 17:24:37.602173 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 542/1104] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:24:37 2022] DELETE /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:24:37.611534 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-30bb1c5c-90ed-4233-8656-02d2b6e4950b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:37.612142 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-30bb1c5c-90ed-4233-8656-02d2b6e4950b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:37.618567 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30bb1c5c-90ed-4233-8656-02d2b6e4950b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:37.619017 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30bb1c5c-90ed-4233-8656-02d2b6e4950b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:37.619814 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30bb1c5c-90ed-4233-8656-02d2b6e4950b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:37.620280 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30bb1c5c-90ed-4233-8656-02d2b6e4950b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:37.769972 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-30bb1c5c-90ed-4233-8656-02d2b6e4950b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:37.778695 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-30bb1c5c-90ed-4233-8656-02d2b6e4950b tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1578 microversion: 2.1 time: 0.171596 Jun 23 17:24:37.781305 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 563/1105] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:37 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:38.413816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d34683a9-d011-4b53-800a-2b154b877a50 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:38.414495 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d34683a9-d011-4b53-800a-2b154b877a50 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:38.422410 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d34683a9-d011-4b53-800a-2b154b877a50 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:38.423340 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d34683a9-d011-4b53-800a-2b154b877a50 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:38.424123 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d34683a9-d011-4b53-800a-2b154b877a50 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:38.424565 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d34683a9-d011-4b53-800a-2b154b877a50 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:38.453999 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d34683a9-d011-4b53-800a-2b154b877a50 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:24:38.537736 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d34683a9-d011-4b53-800a-2b154b877a50 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 204 len: 0 microversion: 2.1 time: 0.127894 Jun 23 17:24:38.538379 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 543/1106] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:24:38 2022] DELETE /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:24:38.546760 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-26900c1a-b69c-4eb4-8c18-cca727d38285 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:38.547362 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-26900c1a-b69c-4eb4-8c18-cca727d38285 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:38.553688 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-26900c1a-b69c-4eb4-8c18-cca727d38285 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:38.554169 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-26900c1a-b69c-4eb4-8c18-cca727d38285 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:38.554929 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-26900c1a-b69c-4eb4-8c18-cca727d38285 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:38.555357 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-26900c1a-b69c-4eb4-8c18-cca727d38285 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:38.706088 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-26900c1a-b69c-4eb4-8c18-cca727d38285 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:38.713574 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-26900c1a-b69c-4eb4-8c18-cca727d38285 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 200 len: 1513 microversion: 2.1 time: 0.170806 Jun 23 17:24:38.714336 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 564/1107] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:38 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:38.802310 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1864f47d-dad2-489e-91db-881be7274d12 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:38.803452 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1864f47d-dad2-489e-91db-881be7274d12 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:38.812004 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1864f47d-dad2-489e-91db-881be7274d12 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:38.812686 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1864f47d-dad2-489e-91db-881be7274d12 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:38.813833 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1864f47d-dad2-489e-91db-881be7274d12 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:38.814487 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1864f47d-dad2-489e-91db-881be7274d12 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:38.966150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1864f47d-dad2-489e-91db-881be7274d12 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:38.974122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1864f47d-dad2-489e-91db-881be7274d12 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1578 microversion: 2.1 time: 0.178961 Jun 23 17:24:38.974725 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 544/1108] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:38 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1578 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:39.731564 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-51df6a8c-1db0-4cd9-8525-8549e4eb9730 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:39.732189 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-51df6a8c-1db0-4cd9-8525-8549e4eb9730 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:39.739095 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-51df6a8c-1db0-4cd9-8525-8549e4eb9730 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:39.739535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-51df6a8c-1db0-4cd9-8525-8549e4eb9730 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:39.740285 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-51df6a8c-1db0-4cd9-8525-8549e4eb9730 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:39.740717 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-51df6a8c-1db0-4cd9-8525-8549e4eb9730 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:39.889665 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-51df6a8c-1db0-4cd9-8525-8549e4eb9730 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:39.894820 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:39.901275 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-51df6a8c-1db0-4cd9-8525-8549e4eb9730 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 200 len: 1513 microversion: 2.1 time: 0.173441 Jun 23 17:24:39.901919 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 565/1109] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:39 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:39.991638 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-03630ed5-211d-4b6b-8c3f-4251398421e1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:39.992284 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-03630ed5-211d-4b6b-8c3f-4251398421e1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:39.999734 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-03630ed5-211d-4b6b-8c3f-4251398421e1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:40.000187 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-03630ed5-211d-4b6b-8c3f-4251398421e1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:40.000952 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-03630ed5-211d-4b6b-8c3f-4251398421e1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:40.001390 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-03630ed5-211d-4b6b-8c3f-4251398421e1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:40.019847 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:40.306474 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-03630ed5-211d-4b6b-8c3f-4251398421e1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:40.315214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-03630ed5-211d-4b6b-8c3f-4251398421e1 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1578 microversion: 2.1 time: 0.327565 Jun 23 17:24:40.315870 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 545/1110] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:39 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1578 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:40.734560 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-a60cb017-4f58-459c-bcd7-127f60102d9f req-5c4ae7ba-a06f-472a-861f-2f19f56c87ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6202caa7-6072-4d4f-adf6-9e6effa0cae3", "name": "network-vif-deleted", "tag": "3da60010-d040-4053-a999-f4b58c9362b0"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:24:40.743741 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-a60cb017-4f58-459c-bcd7-127f60102d9f req-5c4ae7ba-a06f-472a-861f-2f19f56c87ba service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:40.744189 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-a60cb017-4f58-459c-bcd7-127f60102d9f req-5c4ae7ba-a06f-472a-861f-2f19f56c87ba service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:40.755653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-a60cb017-4f58-459c-bcd7-127f60102d9f req-5c4ae7ba-a06f-472a-861f-2f19f56c87ba service nova] Creating event network-vif-deleted:3da60010-d040-4053-a999-f4b58c9362b0 for instance 6202caa7-6072-4d4f-adf6-9e6effa0cae3 on hv-cinder-83538 Jun 23 17:24:40.760826 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-a60cb017-4f58-459c-bcd7-127f60102d9f req-5c4ae7ba-a06f-472a-861f-2f19f56c87ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030624 Jun 23 17:24:40.761577 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 566/1111] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:24:40.923957 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9b364b11-fecd-49a5-837b-a51db125a656 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:40.924540 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9b364b11-fecd-49a5-837b-a51db125a656 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:40.932243 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9b364b11-fecd-49a5-837b-a51db125a656 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:40.932782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9b364b11-fecd-49a5-837b-a51db125a656 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:40.933572 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9b364b11-fecd-49a5-837b-a51db125a656 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:40.933967 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9b364b11-fecd-49a5-837b-a51db125a656 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:41.163977 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9b364b11-fecd-49a5-837b-a51db125a656 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:41.181405 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9b364b11-fecd-49a5-837b-a51db125a656 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 200 len: 1513 microversion: 2.1 time: 0.261328 Jun 23 17:24:41.182532 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 546/1112] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:40 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 1513 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:41.333499 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4f461426-2bba-4b80-bece-30372dc8a746 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:41.334228 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4f461426-2bba-4b80-bece-30372dc8a746 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:41.340925 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4f461426-2bba-4b80-bece-30372dc8a746 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:41.341408 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4f461426-2bba-4b80-bece-30372dc8a746 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:41.342212 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4f461426-2bba-4b80-bece-30372dc8a746 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:41.342648 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4f461426-2bba-4b80-bece-30372dc8a746 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:41.375124 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4f461426-2bba-4b80-bece-30372dc8a746 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:41.375546 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4f461426-2bba-4b80-bece-30372dc8a746 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:41.376134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-4f461426-2bba-4b80-bece-30372dc8a746 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lazy-loading 'fault' on Instance uuid 6202caa7-6072-4d4f-adf6-9e6effa0cae3 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:24:41.424083 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4f461426-2bba-4b80-bece-30372dc8a746 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21524f4232648ebaed76e1d7d5daf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e393091e3c2d42e79e9f2ec80d471faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:41.432814 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4f461426-2bba-4b80-bece-30372dc8a746 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 200 len: 1230 microversion: 2.1 time: 0.103391 Jun 23 17:24:41.433628 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 567/1113] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:41 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:42.201956 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cd45b8b2-9092-4dc2-b2e9-58c756605f35 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:42.202584 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cd45b8b2-9092-4dc2-b2e9-58c756605f35 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: 95ad824e-0ca7-45df-b884-760e7612a09b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:42.210034 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd45b8b2-9092-4dc2-b2e9-58c756605f35 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:42.210483 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd45b8b2-9092-4dc2-b2e9-58c756605f35 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:42.211249 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd45b8b2-9092-4dc2-b2e9-58c756605f35 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:42.211687 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd45b8b2-9092-4dc2-b2e9-58c756605f35 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:42.231822 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-cd45b8b2-9092-4dc2-b2e9-58c756605f35 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] HTTP exception thrown: Instance 95ad824e-0ca7-45df-b884-760e7612a09b could not be found. Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cd45b8b2-9092-4dc2-b2e9-58c756605f35 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Request method failure captured: Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b HTTP/1.1 Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitKGScKIsVWevp_ed7J5L6Gt4W4S_Chhcs2heiypREFfKSA0Fu6rzspdrgDT_X_wm8FszlTRayvuLYPJxAE4PufdfxECbnKbyxhXNPgGZeThp_EuO_3NC67mgq-kT0Z7lI4Zj31aNWL6kzI2fz8BqDtOwkvszSZlpRuuh1choVdmTtD8 Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: ac4cd16fac46470eb48bb273b12ac6f0 Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1300618096 Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:24:42.233828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:24:42.235816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ac4cd16fac46470eb48bb273b12ac6f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac4cd16fac46470eb48bb273b12ac6f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ac4cd16fac46470eb48bb273b12ac6f0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac4cd16fac46470eb48bb273b12ac6f0"}]}] Jun 23 17:24:42.235816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-VolumesSnapshotTestJSON-1300618096 Jun 23 17:24:42.235816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: ac4cd16fac46470eb48bb273b12ac6f0 Jun 23 17:24:42.235816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1300618096 Jun 23 17:24:42.235816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-VolumesSnapshotTestJSON-1300618096-project Jun 23 17:24:42.235816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:24:42.235816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:24:42.235816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: 9ee5ba617c5f4038930c30773c207a58 Jun 23 17:24:42.235816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-VolumesSnapshotTestJSON-1300618096-project Jun 23 17:24:42.235816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:24:42.235816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 95ad824e-0ca7-45df-b884-760e7612a09b could not be found. Jun 23 17:24:42.235816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '95ad824e-0ca7-45df-b884-760e7612a09b'} Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95ad824e-0ca7-45df-b884-760e7612a09b could not be found. Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:24:42.236930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95ad824e-0ca7-45df-b884-760e7612a09b could not be found. Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95ad824e-0ca7-45df-b884-760e7612a09b could not be found. Jun 23 17:24:42.238782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.240212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cd45b8b2-9092-4dc2-b2e9-58c756605f35 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Returning 404 to user: Instance 95ad824e-0ca7-45df-b884-760e7612a09b could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:24:42.240212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cd45b8b2-9092-4dc2-b2e9-58c756605f35 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b" status: 404 len: 111 microversion: 2.1 time: 0.038638 Jun 23 17:24:42.240212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 547/1114] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:42 2022] GET /compute/v2.1/servers/95ad824e-0ca7-45df-b884-760e7612a09b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:24:42.450322 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d88a5ae5-5278-4ddb-b574-f33f1e9eb381 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:42.450916 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d88a5ae5-5278-4ddb-b574-f33f1e9eb381 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: 6202caa7-6072-4d4f-adf6-9e6effa0cae3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:42.458052 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d88a5ae5-5278-4ddb-b574-f33f1e9eb381 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:42.458504 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d88a5ae5-5278-4ddb-b574-f33f1e9eb381 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:42.459261 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d88a5ae5-5278-4ddb-b574-f33f1e9eb381 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:42.459698 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d88a5ae5-5278-4ddb-b574-f33f1e9eb381 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:42.473295 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-d88a5ae5-5278-4ddb-b574-f33f1e9eb381 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] HTTP exception thrown: Instance 6202caa7-6072-4d4f-adf6-9e6effa0cae3 could not be found. Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d88a5ae5-5278-4ddb-b574-f33f1e9eb381 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Request method failure captured: Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 HTTP/1.1 Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ-Z7KVHuHnfXlIDzhurTdoORYdnBzHAr5K0ur7EnGyKR6wQYakIQ2uL7npIPAmkACn9VYnkSubroH6VRhjui17QkxWDkJjnAdu83-3gecDXsf0Z6QKwJ5dJ1yd2WCbnd4Ty3dKLOGUxf3VFRz28vh_EMNU8Dd39unN-rIVaoddQb2o Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: e393091e3c2d42e79e9f2ec80d471faf Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-TestVolumeBootPattern-609773018 Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:24:42.474975 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:24:42.476524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e393091e3c2d42e79e9f2ec80d471faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e393091e3c2d42e79e9f2ec80d471faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e393091e3c2d42e79e9f2ec80d471faf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e393091e3c2d42e79e9f2ec80d471faf"}]}] Jun 23 17:24:42.476524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-TestVolumeBootPattern-609773018 Jun 23 17:24:42.476524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: e393091e3c2d42e79e9f2ec80d471faf Jun 23 17:24:42.476524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-TestVolumeBootPattern-609773018 Jun 23 17:24:42.476524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-TestVolumeBootPattern-609773018-project Jun 23 17:24:42.476524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:24:42.476524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:24:42.476524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: d21524f4232648ebaed76e1d7d5daf5f Jun 23 17:24:42.476524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-TestVolumeBootPattern-609773018-project Jun 23 17:24:42.476524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:24:42.476524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance 6202caa7-6072-4d4f-adf6-9e6effa0cae3 could not be found. Jun 23 17:24:42.476524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '6202caa7-6072-4d4f-adf6-9e6effa0cae3'} Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6202caa7-6072-4d4f-adf6-9e6effa0cae3 could not be found. Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:24:42.477444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6202caa7-6072-4d4f-adf6-9e6effa0cae3 could not be found. Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6202caa7-6072-4d4f-adf6-9e6effa0cae3 could not be found. Jun 23 17:24:42.478985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.480344 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d88a5ae5-5278-4ddb-b574-f33f1e9eb381 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Returning 404 to user: Instance 6202caa7-6072-4d4f-adf6-9e6effa0cae3 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:24:42.480344 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d88a5ae5-5278-4ddb-b574-f33f1e9eb381 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3" status: 404 len: 111 microversion: 2.1 time: 0.030203 Jun 23 17:24:42.480344 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 568/1115] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:42 2022] GET /compute/v2.1/servers/6202caa7-6072-4d4f-adf6-9e6effa0cae3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:24:42.775444 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-b48dca07-c75a-4e06-b08f-72b76c5f5269 req-7140831c-ebb8-469c-920e-30e76f708e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ad824e-0ca7-45df-b884-760e7612a09b", "name": "network-vif-deleted", "tag": "95c2c7a4-7a6a-42d4-99c2-f6dfd82c8201"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:24:42.784192 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b48dca07-c75a-4e06-b08f-72b76c5f5269 req-7140831c-ebb8-469c-920e-30e76f708e0d service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:42.784736 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b48dca07-c75a-4e06-b08f-72b76c5f5269 req-7140831c-ebb8-469c-920e-30e76f708e0d service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:42.796915 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-b48dca07-c75a-4e06-b08f-72b76c5f5269 req-7140831c-ebb8-469c-920e-30e76f708e0d service nova] Creating event network-vif-deleted:95c2c7a4-7a6a-42d4-99c2-f6dfd82c8201 for instance 95ad824e-0ca7-45df-b884-760e7612a09b on hv-cinder-83538 Jun 23 17:24:42.802433 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-b48dca07-c75a-4e06-b08f-72b76c5f5269 req-7140831c-ebb8-469c-920e-30e76f708e0d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030652 Jun 23 17:24:42.802990 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 548/1116] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:24:42.933895 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4bd7f5f0-7e9f-4d4f-bcb1-147f84b467a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:42.934467 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4bd7f5f0-7e9f-4d4f-bcb1-147f84b467a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:42.942924 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4bd7f5f0-7e9f-4d4f-bcb1-147f84b467a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:42.943377 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4bd7f5f0-7e9f-4d4f-bcb1-147f84b467a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:42.944155 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4bd7f5f0-7e9f-4d4f-bcb1-147f84b467a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:42.944593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4bd7f5f0-7e9f-4d4f-bcb1-147f84b467a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:42.958746 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-4bd7f5f0-7e9f-4d4f-bcb1-147f84b467a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] HTTP exception thrown: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4bd7f5f0-7e9f-4d4f-bcb1-147f84b467a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Request method failure captured: Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: DELETE /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee HTTP/1.1 Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitJ-Z7KVHuHnfXlIDzhurTdoORYdnBzHAr5K0ur7EnGyKR6wQYakIQ2uL7npIPAmkACn9VYnkSubroH6VRhjui17QkxWDkJjnAdu83-3gecDXsf0Z6QKwJ5dJ1yd2WCbnd4Ty3dKLOGUxf3VFRz28vh_EMNU8Dd39unN-rIVaoddQb2o Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: e393091e3c2d42e79e9f2ec80d471faf Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-TestVolumeBootPattern-609773018 Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:24:42.960299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:24:42.961911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e393091e3c2d42e79e9f2ec80d471faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e393091e3c2d42e79e9f2ec80d471faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e393091e3c2d42e79e9f2ec80d471faf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e393091e3c2d42e79e9f2ec80d471faf"}]}] Jun 23 17:24:42.961911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-TestVolumeBootPattern-609773018 Jun 23 17:24:42.961911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: e393091e3c2d42e79e9f2ec80d471faf Jun 23 17:24:42.961911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-TestVolumeBootPattern-609773018 Jun 23 17:24:42.961911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-TestVolumeBootPattern-609773018-project Jun 23 17:24:42.961911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:24:42.961911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:24:42.961911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: d21524f4232648ebaed76e1d7d5daf5f Jun 23 17:24:42.961911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-TestVolumeBootPattern-609773018-project Jun 23 17:24:42.961911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:24:42.961911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:24:42.961911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': 'b8f045dd-0ec4-4225-8bae-0035daa2c0ee'} Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:24:42.962864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:24:42.964409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:24:42.966361 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4bd7f5f0-7e9f-4d4f-bcb1-147f84b467a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Returning 404 to user: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:24:42.966361 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4bd7f5f0-7e9f-4d4f-bcb1-147f84b467a0 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 404 len: 111 microversion: 2.1 time: 0.032315 Jun 23 17:24:42.966361 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 569/1117] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:24:42 2022] DELETE /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:24:42.973229 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f57fe6c9-dd77-4c3a-b11a-8a915ad0c3a3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:42.974210 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f57fe6c9-dd77-4c3a-b11a-8a915ad0c3a3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] [instance: b8f045dd-0ec4-4225-8bae-0035daa2c0ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:42.982311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f57fe6c9-dd77-4c3a-b11a-8a915ad0c3a3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:42.982764 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f57fe6c9-dd77-4c3a-b11a-8a915ad0c3a3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:42.983533 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f57fe6c9-dd77-4c3a-b11a-8a915ad0c3a3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:42.983970 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f57fe6c9-dd77-4c3a-b11a-8a915ad0c3a3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:43.000388 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-f57fe6c9-dd77-4c3a-b11a-8a915ad0c3a3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] HTTP exception thrown: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f57fe6c9-dd77-4c3a-b11a-8a915ad0c3a3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Request method failure captured: Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee HTTP/1.1 Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitJ-Z7KVHuHnfXlIDzhurTdoORYdnBzHAr5K0ur7EnGyKR6wQYakIQ2uL7npIPAmkACn9VYnkSubroH6VRhjui17QkxWDkJjnAdu83-3gecDXsf0Z6QKwJ5dJ1yd2WCbnd4Ty3dKLOGUxf3VFRz28vh_EMNU8Dd39unN-rIVaoddQb2o Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: e393091e3c2d42e79e9f2ec80d471faf Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-TestVolumeBootPattern-609773018 Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:24:43.002018 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:24:43.003770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e393091e3c2d42e79e9f2ec80d471faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e393091e3c2d42e79e9f2ec80d471faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e393091e3c2d42e79e9f2ec80d471faf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e393091e3c2d42e79e9f2ec80d471faf"}]}] Jun 23 17:24:43.003770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-TestVolumeBootPattern-609773018 Jun 23 17:24:43.003770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: e393091e3c2d42e79e9f2ec80d471faf Jun 23 17:24:43.003770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-TestVolumeBootPattern-609773018 Jun 23 17:24:43.003770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-TestVolumeBootPattern-609773018-project Jun 23 17:24:43.003770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:24:43.003770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:24:43.003770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: d21524f4232648ebaed76e1d7d5daf5f Jun 23 17:24:43.003770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-TestVolumeBootPattern-609773018-project Jun 23 17:24:43.003770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:24:43.003770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:24:43.003770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': 'b8f045dd-0ec4-4225-8bae-0035daa2c0ee'} Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:24:43.004701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. Jun 23 17:24:43.006211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:24:43.007513 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f57fe6c9-dd77-4c3a-b11a-8a915ad0c3a3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Returning 404 to user: Instance b8f045dd-0ec4-4225-8bae-0035daa2c0ee could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:24:43.007513 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f57fe6c9-dd77-4c3a-b11a-8a915ad0c3a3 tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee" status: 404 len: 111 microversion: 2.1 time: 0.035443 Jun 23 17:24:43.007513 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 549/1118] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:42 2022] GET /compute/v2.1/servers/b8f045dd-0ec4-4225-8bae-0035daa2c0ee => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:24:47.494549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7e347570-eaa5-4dc7-bdc4-053ac990125a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] Calling method '.version_select at 0x7f342dd99820>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:47.516508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7e347570-eaa5-4dc7-bdc4-053ac990125a tempest-TestVolumeBootPattern-609773018 tempest-TestVolumeBootPattern-609773018-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1835957938" status: 202 len: 0 microversion: 2.1 time: 0.025591 Jun 23 17:24:47.517314 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 570/1119] 10.222.0.18 () {58 vars in 1262 bytes} [Thu Jun 23 17:24:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1835957938 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:24:52.125033 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1489750123", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "networks": [{"uuid": "621ad951-6b5b-460e-b196-77ea13cf7a1e"}]}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:24:52.182723 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] validate_networks() for [('621ad951-6b5b-460e-b196-77ea13cf7a1e', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:24:52.989277 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=14 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:53.136789 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:24:53.137408 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:24:53.137646 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:24:53.138093 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:24:53.138662 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:24:53.148008 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:53.148458 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:53.149280 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:53.149728 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:53.169232 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Getting quotas for project ac4cd16fac46470eb48bb273b12ac6f0. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:24:53.174234 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Getting quotas for user 9ee5ba617c5f4038930c30773c207a58 and project ac4cd16fac46470eb48bb273b12ac6f0. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:24:53.186954 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:24:53.189286 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:24:53.237309 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [11db0d7f-6458-423c-b041-5811016f176a] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 17:24:54.247902 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [11db0d7f-6458-423c-b041-5811016f176a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43014. Jun 23 17:24:54.261938 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b6f6f587-8f4e-4817-8fc7-13bacfb46c11 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.131735 Jun 23 17:24:54.265245 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 550/1120] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:24:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:24:54.276431 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-937e883a-f8bf-4054-89ec-e36702ccb59f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:54.277294 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-937e883a-f8bf-4054-89ec-e36702ccb59f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:54.290728 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=14 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:54.372658 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-937e883a-f8bf-4054-89ec-e36702ccb59f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:54.384769 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-937e883a-f8bf-4054-89ec-e36702ccb59f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 200 len: 1219 microversion: 2.1 time: 0.112741 Jun 23 17:24:54.394832 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 571/1121] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:54 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:55.402586 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c67c3fa6-a72d-4854-8986-2e6fe5972dad tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:55.403988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c67c3fa6-a72d-4854-8986-2e6fe5972dad tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:55.416519 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c67c3fa6-a72d-4854-8986-2e6fe5972dad tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:55.417281 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c67c3fa6-a72d-4854-8986-2e6fe5972dad tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:55.418284 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c67c3fa6-a72d-4854-8986-2e6fe5972dad tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:55.420310 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c67c3fa6-a72d-4854-8986-2e6fe5972dad tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:55.519118 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c67c3fa6-a72d-4854-8986-2e6fe5972dad tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:55.528786 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c67c3fa6-a72d-4854-8986-2e6fe5972dad tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 200 len: 1289 microversion: 2.1 time: 0.130147 Jun 23 17:24:55.529354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 551/1122] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:55 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 1289 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:56.548080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-30e835ec-a2b1-4bcc-b97e-37b71963448f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:56.548669 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-30e835ec-a2b1-4bcc-b97e-37b71963448f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:56.555693 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30e835ec-a2b1-4bcc-b97e-37b71963448f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:56.556147 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30e835ec-a2b1-4bcc-b97e-37b71963448f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:56.556891 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30e835ec-a2b1-4bcc-b97e-37b71963448f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:56.557647 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-30e835ec-a2b1-4bcc-b97e-37b71963448f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:56.710770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-455d82b2-ee47-4b43-aa06-ec8a19d2f78b req-37028015-8495-4805-9b6e-639cdcf893ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca70a9d7-3e75-41a0-abf9-a43cedf6ce80", "tag": "6fce90ed-a67b-4419-a80a-db7b92f51bff"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:24:56.717305 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-30e835ec-a2b1-4bcc-b97e-37b71963448f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:56.730056 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-30e835ec-a2b1-4bcc-b97e-37b71963448f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 200 len: 1319 microversion: 2.1 time: 0.186156 Jun 23 17:24:56.730643 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 572/1123] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:56 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:56.731322 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-455d82b2-ee47-4b43-aa06-ec8a19d2f78b req-37028015-8495-4805-9b6e-639cdcf893ee service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:56.731764 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-455d82b2-ee47-4b43-aa06-ec8a19d2f78b req-37028015-8495-4805-9b6e-639cdcf893ee service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:56.743562 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-455d82b2-ee47-4b43-aa06-ec8a19d2f78b req-37028015-8495-4805-9b6e-639cdcf893ee service nova] Creating event network-changed:6fce90ed-a67b-4419-a80a-db7b92f51bff for instance ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 on hv-cinder-83538 Jun 23 17:24:56.748390 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-455d82b2-ee47-4b43-aa06-ec8a19d2f78b req-37028015-8495-4805-9b6e-639cdcf893ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048938 Jun 23 17:24:56.749362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 552/1124] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:24:57.747758 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-46148811-ab74-4c82-9a97-707d9ab32231 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:57.748345 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-46148811-ab74-4c82-9a97-707d9ab32231 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:57.755664 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-46148811-ab74-4c82-9a97-707d9ab32231 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:57.756109 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-46148811-ab74-4c82-9a97-707d9ab32231 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:57.756870 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-46148811-ab74-4c82-9a97-707d9ab32231 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:57.757299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-46148811-ab74-4c82-9a97-707d9ab32231 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:57.913262 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-46148811-ab74-4c82-9a97-707d9ab32231 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:57.923709 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-46148811-ab74-4c82-9a97-707d9ab32231 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 200 len: 1319 microversion: 2.1 time: 0.179930 Jun 23 17:24:57.924278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 573/1125] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:57 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:24:58.942498 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-86abe7e9-1007-4d59-886b-e5a162f4416e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:24:58.943234 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-86abe7e9-1007-4d59-886b-e5a162f4416e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:24:58.953541 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-86abe7e9-1007-4d59-886b-e5a162f4416e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:58.954357 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-86abe7e9-1007-4d59-886b-e5a162f4416e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:58.955676 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-86abe7e9-1007-4d59-886b-e5a162f4416e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:24:58.956460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-86abe7e9-1007-4d59-886b-e5a162f4416e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:24:59.118901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-86abe7e9-1007-4d59-886b-e5a162f4416e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:24:59.127647 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-86abe7e9-1007-4d59-886b-e5a162f4416e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 200 len: 1319 microversion: 2.1 time: 0.189996 Jun 23 17:24:59.128349 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 553/1126] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:24:58 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:25:00.150854 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-2bfb2542-3990-40b0-a319-7c9854f5472e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:25:00.151429 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-2bfb2542-3990-40b0-a319-7c9854f5472e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:25:00.158346 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2bfb2542-3990-40b0-a319-7c9854f5472e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:00.158796 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2bfb2542-3990-40b0-a319-7c9854f5472e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:00.159606 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2bfb2542-3990-40b0-a319-7c9854f5472e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:00.160036 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2bfb2542-3990-40b0-a319-7c9854f5472e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:00.302937 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2bfb2542-3990-40b0-a319-7c9854f5472e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:25:00.311266 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-2bfb2542-3990-40b0-a319-7c9854f5472e tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 200 len: 1319 microversion: 2.1 time: 0.164526 Jun 23 17:25:00.312273 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 574/1127] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:25:00 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:25:01.335770 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a9757bb8-28c3-4e6f-b765-7cf3f84ac42c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:25:01.336656 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a9757bb8-28c3-4e6f-b765-7cf3f84ac42c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:25:01.346336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a9757bb8-28c3-4e6f-b765-7cf3f84ac42c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:01.346774 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a9757bb8-28c3-4e6f-b765-7cf3f84ac42c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:01.347558 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a9757bb8-28c3-4e6f-b765-7cf3f84ac42c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:01.347985 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a9757bb8-28c3-4e6f-b765-7cf3f84ac42c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:01.486318 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a9757bb8-28c3-4e6f-b765-7cf3f84ac42c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:25:01.494470 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a9757bb8-28c3-4e6f-b765-7cf3f84ac42c tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 200 len: 1319 microversion: 2.1 time: 0.165439 Jun 23 17:25:01.495042 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 554/1128] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:25:01 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:25:02.515713 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1da1e890-2b19-4437-a545-7ba0457e407f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:25:02.516514 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1da1e890-2b19-4437-a545-7ba0457e407f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:25:02.523364 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1da1e890-2b19-4437-a545-7ba0457e407f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:02.523806 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1da1e890-2b19-4437-a545-7ba0457e407f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:02.524557 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1da1e890-2b19-4437-a545-7ba0457e407f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:02.524985 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1da1e890-2b19-4437-a545-7ba0457e407f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:02.667072 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1da1e890-2b19-4437-a545-7ba0457e407f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:25:02.676363 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1da1e890-2b19-4437-a545-7ba0457e407f tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 200 len: 1319 microversion: 2.1 time: 0.167202 Jun 23 17:25:02.676921 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 575/1129] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:25:02 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:25:03.647592 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-224d47e6-d83d-43ab-894b-475551b8a94d req-a215a96e-ce96-4d00-a4bf-67a9a44ff836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca70a9d7-3e75-41a0-abf9-a43cedf6ce80", "name": "network-vif-plugged", "status": "completed", "tag": "6fce90ed-a67b-4419-a80a-db7b92f51bff"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:25:03.651696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:25:03.652709 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:25:03.653361 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:25:03.659492 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-224d47e6-d83d-43ab-894b-475551b8a94d req-a215a96e-ce96-4d00-a4bf-67a9a44ff836 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:03.660254 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-224d47e6-d83d-43ab-894b-475551b8a94d req-a215a96e-ce96-4d00-a4bf-67a9a44ff836 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:03.673431 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-224d47e6-d83d-43ab-894b-475551b8a94d req-a215a96e-ce96-4d00-a4bf-67a9a44ff836 service nova] Creating event network-vif-plugged:6fce90ed-a67b-4419-a80a-db7b92f51bff for instance ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 on hv-cinder-83538 Jun 23 17:25:03.679255 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-224d47e6-d83d-43ab-894b-475551b8a94d req-a215a96e-ce96-4d00-a4bf-67a9a44ff836 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036032 Jun 23 17:25:03.679846 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 555/1130] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:25:03.694752 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1fcec8ec-07cc-4ad2-9455-f0712c1a3eca tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:25:03.696017 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1fcec8ec-07cc-4ad2-9455-f0712c1a3eca tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:25:03.702609 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1fcec8ec-07cc-4ad2-9455-f0712c1a3eca tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:03.703052 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1fcec8ec-07cc-4ad2-9455-f0712c1a3eca tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:03.703842 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1fcec8ec-07cc-4ad2-9455-f0712c1a3eca tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:03.704402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1fcec8ec-07cc-4ad2-9455-f0712c1a3eca tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:03.840901 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1fcec8ec-07cc-4ad2-9455-f0712c1a3eca tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:25:03.849271 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1fcec8ec-07cc-4ad2-9455-f0712c1a3eca tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 200 len: 1319 microversion: 2.1 time: 0.159446 Jun 23 17:25:03.849871 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 576/1131] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:25:03 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:25:04.867214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a09500de-1ea1-4f7d-8345-41ee1f23f994 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:25:04.867914 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a09500de-1ea1-4f7d-8345-41ee1f23f994 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:25:04.874378 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a09500de-1ea1-4f7d-8345-41ee1f23f994 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:04.874831 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a09500de-1ea1-4f7d-8345-41ee1f23f994 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:04.875622 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a09500de-1ea1-4f7d-8345-41ee1f23f994 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:04.876053 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a09500de-1ea1-4f7d-8345-41ee1f23f994 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:05.013257 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a09500de-1ea1-4f7d-8345-41ee1f23f994 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:25:05.024545 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a09500de-1ea1-4f7d-8345-41ee1f23f994 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 200 len: 1319 microversion: 2.1 time: 0.162143 Jun 23 17:25:05.025208 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 556/1132] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:25:04 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:25:06.044277 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4f77ec1b-001e-4732-8ebe-792d6ad99a02 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:25:06.045067 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4f77ec1b-001e-4732-8ebe-792d6ad99a02 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:25:06.048068 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=2 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:25:06.050204 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:25:06.058771 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4f77ec1b-001e-4732-8ebe-792d6ad99a02 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:06.059216 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4f77ec1b-001e-4732-8ebe-792d6ad99a02 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:06.059969 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4f77ec1b-001e-4732-8ebe-792d6ad99a02 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:06.060392 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4f77ec1b-001e-4732-8ebe-792d6ad99a02 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:06.202578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4f77ec1b-001e-4732-8ebe-792d6ad99a02 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:25:06.210543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4f77ec1b-001e-4732-8ebe-792d6ad99a02 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 200 len: 1508 microversion: 2.1 time: 0.172899 Jun 23 17:25:06.211112 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 577/1133] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:25:06 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:25:06.227113 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8ba54c83-a3f5-4bad-9efc-9a588c7a8496 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec58b215-f8e8-4fc4-a418-a3764b1c0759", "device": "/dev/sdb"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:25:06.228729 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8ba54c83-a3f5-4bad-9efc-9a588c7a8496 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:25:06.235472 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8ba54c83-a3f5-4bad-9efc-9a588c7a8496 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:06.235917 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8ba54c83-a3f5-4bad-9efc-9a588c7a8496 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:06.236711 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8ba54c83-a3f5-4bad-9efc-9a588c7a8496 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:06.237115 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8ba54c83-a3f5-4bad-9efc-9a588c7a8496 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:06.504120 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8ba54c83-a3f5-4bad-9efc-9a588c7a8496 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "POST /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280778 Jun 23 17:25:06.504739 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 557/1134] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 23 17:25:06 2022] POST /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 17:25:28.040099 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fc0326e6-1ecc-4d4c-9548-e97a205cb1a3 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:25:28.040704 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fc0326e6-1ecc-4d4c-9548-e97a205cb1a3 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:25:28.042784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:25:28.043451 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=36 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:25:28.049911 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc0326e6-1ecc-4d4c-9548-e97a205cb1a3 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:28.050351 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc0326e6-1ecc-4d4c-9548-e97a205cb1a3 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:28.051104 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc0326e6-1ecc-4d4c-9548-e97a205cb1a3 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:28.051538 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fc0326e6-1ecc-4d4c-9548-e97a205cb1a3 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:28.147635 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-fc0326e6-1ecc-4d4c-9548-e97a205cb1a3 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lazy-loading 'services' on Instance uuid ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:25:28.231411 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-fc0326e6-1ecc-4d4c-9548-e97a205cb1a3 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80/os-volume_attachments/ec58b215-f8e8-4fc4-a418-a3764b1c0759" status: 202 len: 0 microversion: 2.1 time: 0.195506 Jun 23 17:25:28.231997 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 578/1135] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 23 17:25:28 2022] DELETE /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80/os-volume_attachments/ec58b215-f8e8-4fc4-a418-a3764b1c0759 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:25:29.353362 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=5 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:25:29.354228 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:25:29.358368 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f1571f34-30a6-4809-bcf6-3672f7a85179 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:25:29.358992 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f1571f34-30a6-4809-bcf6-3672f7a85179 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:25:29.366235 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1571f34-30a6-4809-bcf6-3672f7a85179 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:29.366655 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1571f34-30a6-4809-bcf6-3672f7a85179 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:29.367399 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1571f34-30a6-4809-bcf6-3672f7a85179 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:29.367825 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1571f34-30a6-4809-bcf6-3672f7a85179 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:29.393632 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f1571f34-30a6-4809-bcf6-3672f7a85179 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:25:29.486425 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f1571f34-30a6-4809-bcf6-3672f7a85179 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 204 len: 0 microversion: 2.1 time: 0.134408 Jun 23 17:25:29.487049 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 558/1136] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:25:29 2022] DELETE /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:25:29.497184 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9614e6cc-91c1-4493-986e-4b198071cac2 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:25:29.497917 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9614e6cc-91c1-4493-986e-4b198071cac2 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:25:29.504386 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9614e6cc-91c1-4493-986e-4b198071cac2 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:29.504836 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9614e6cc-91c1-4493-986e-4b198071cac2 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:29.505594 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9614e6cc-91c1-4493-986e-4b198071cac2 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:29.506056 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9614e6cc-91c1-4493-986e-4b198071cac2 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:29.636801 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9614e6cc-91c1-4493-986e-4b198071cac2 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:25:29.644962 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9614e6cc-91c1-4493-986e-4b198071cac2 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 200 len: 1514 microversion: 2.1 time: 0.152699 Jun 23 17:25:29.645482 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 579/1137] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:25:29 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:25:30.664538 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bd817273-8c81-4930-9863-848c4f422407 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:25:30.665313 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bd817273-8c81-4930-9863-848c4f422407 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:25:30.672948 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bd817273-8c81-4930-9863-848c4f422407 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:30.673442 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bd817273-8c81-4930-9863-848c4f422407 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:30.674589 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bd817273-8c81-4930-9863-848c4f422407 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:30.675070 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bd817273-8c81-4930-9863-848c4f422407 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:30.812663 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bd817273-8c81-4930-9863-848c4f422407 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:25:30.823293 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bd817273-8c81-4930-9863-848c4f422407 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 200 len: 1514 microversion: 2.1 time: 0.163527 Jun 23 17:25:30.823902 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 559/1138] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:25:30 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:25:31.842221 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1bddaf65-37b9-4958-a98a-351e5b07feed tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:25:31.842806 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1bddaf65-37b9-4958-a98a-351e5b07feed tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:25:31.849829 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1bddaf65-37b9-4958-a98a-351e5b07feed tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:31.850302 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1bddaf65-37b9-4958-a98a-351e5b07feed tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:31.851055 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1bddaf65-37b9-4958-a98a-351e5b07feed tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:31.851483 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1bddaf65-37b9-4958-a98a-351e5b07feed tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:31.914801 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1bddaf65-37b9-4958-a98a-351e5b07feed tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5ba617c5f4038930c30773c207a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac4cd16fac46470eb48bb273b12ac6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:25:31.931912 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1bddaf65-37b9-4958-a98a-351e5b07feed tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 200 len: 1472 microversion: 2.1 time: 0.093751 Jun 23 17:25:31.932706 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 580/1139] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:25:31 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 1472 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:25:31.984441 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-b9fa5af4-d14a-480c-9c1a-759970b6370c req-178d70fa-d49b-497a-8929-02194c0eb75d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca70a9d7-3e75-41a0-abf9-a43cedf6ce80", "name": "network-vif-deleted", "tag": "6fce90ed-a67b-4419-a80a-db7b92f51bff"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:25:31.993264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b9fa5af4-d14a-480c-9c1a-759970b6370c req-178d70fa-d49b-497a-8929-02194c0eb75d service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:31.993707 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b9fa5af4-d14a-480c-9c1a-759970b6370c req-178d70fa-d49b-497a-8929-02194c0eb75d service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:32.004901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-b9fa5af4-d14a-480c-9c1a-759970b6370c req-178d70fa-d49b-497a-8929-02194c0eb75d service nova] Creating event network-vif-deleted:6fce90ed-a67b-4419-a80a-db7b92f51bff for instance ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 on hv-cinder-83538 Jun 23 17:25:32.009538 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-b9fa5af4-d14a-480c-9c1a-759970b6370c req-178d70fa-d49b-497a-8929-02194c0eb75d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028848 Jun 23 17:25:32.010185 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 560/1140] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:25:32.952447 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-66a26e3e-bc56-4711-9998-ce85abc2bf03 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:25:32.952958 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-66a26e3e-bc56-4711-9998-ce85abc2bf03 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] [instance: ca70a9d7-3e75-41a0-abf9-a43cedf6ce80] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:25:32.962150 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-66a26e3e-bc56-4711-9998-ce85abc2bf03 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:32.962665 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-66a26e3e-bc56-4711-9998-ce85abc2bf03 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:32.963481 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-66a26e3e-bc56-4711-9998-ce85abc2bf03 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:25:32.963904 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-66a26e3e-bc56-4711-9998-ce85abc2bf03 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:25:32.978318 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-66a26e3e-bc56-4711-9998-ce85abc2bf03 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] HTTP exception thrown: Instance ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 could not be found. Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-66a26e3e-bc56-4711-9998-ce85abc2bf03 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Request method failure captured: Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 HTTP/1.1 Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitKGScKIsVWevp_ed7J5L6Gt4W4S_Chhcs2heiypREFfKSA0Fu6rzspdrgDT_X_wm8FszlTRayvuLYPJxAE4PufdfxECbnKbyxhXNPgGZeThp_EuO_3NC67mgq-kT0Z7lI4Zj31aNWL6kzI2fz8BqDtOwkvszSZlpRuuh1choVdmTtD8 Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: ac4cd16fac46470eb48bb273b12ac6f0 Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1300618096 Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:25:32.979981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:25:32.981654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ac4cd16fac46470eb48bb273b12ac6f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac4cd16fac46470eb48bb273b12ac6f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ac4cd16fac46470eb48bb273b12ac6f0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac4cd16fac46470eb48bb273b12ac6f0"}]}] Jun 23 17:25:32.981654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-VolumesSnapshotTestJSON-1300618096 Jun 23 17:25:32.981654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: ac4cd16fac46470eb48bb273b12ac6f0 Jun 23 17:25:32.981654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1300618096 Jun 23 17:25:32.981654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-VolumesSnapshotTestJSON-1300618096-project Jun 23 17:25:32.981654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:25:32.981654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:25:32.981654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 9ee5ba617c5f4038930c30773c207a58 Jun 23 17:25:32.981654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-VolumesSnapshotTestJSON-1300618096-project Jun 23 17:25:32.981654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:25:32.981654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 could not be found. Jun 23 17:25:32.981654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': 'ca70a9d7-3e75-41a0-abf9-a43cedf6ce80'} Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 could not be found. Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:25:32.982576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 could not be found. Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 could not be found. Jun 23 17:25:32.983918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:25:32.985200 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-66a26e3e-bc56-4711-9998-ce85abc2bf03 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] Returning 404 to user: Instance ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:25:32.985200 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-66a26e3e-bc56-4711-9998-ce85abc2bf03 tempest-VolumesSnapshotTestJSON-1300618096 tempest-VolumesSnapshotTestJSON-1300618096-project] 10.222.0.18 "GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80" status: 404 len: 111 microversion: 2.1 time: 0.035066 Jun 23 17:25:32.985200 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 581/1141] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:25:32 2022] GET /compute/v2.1/servers/ca70a9d7-3e75-41a0-abf9-a43cedf6ce80 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:26:19.341762 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:26:19.342658 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:26:19.619990 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-035ac08b-d8e0-4282-a684-ae963f68a780 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:19.620573 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-035ac08b-d8e0-4282-a684-ae963f68a780 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:19.627599 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-035ac08b-d8e0-4282-a684-ae963f68a780 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:19.628029 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-035ac08b-d8e0-4282-a684-ae963f68a780 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:19.628785 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-035ac08b-d8e0-4282-a684-ae963f68a780 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:19.629212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-035ac08b-d8e0-4282-a684-ae963f68a780 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:19.652893 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-035ac08b-d8e0-4282-a684-ae963f68a780 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78/ips" status: 200 len: 152 microversion: 2.20 time: 0.313225 Jun 23 17:26:19.653436 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 561/1142] 10.222.0.18 () {60 vars in 1288 bytes} [Thu Jun 23 17:26:19 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78/ips => generated 152 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:26:21.463022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5726c25f-7b43-4ad1-a88a-56092401f754 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:26:21.463644 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5726c25f-7b43-4ad1-a88a-56092401f754 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:21.465730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=8 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:26:21.466399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:26:21.472728 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5726c25f-7b43-4ad1-a88a-56092401f754 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:21.473197 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5726c25f-7b43-4ad1-a88a-56092401f754 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:21.473991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5726c25f-7b43-4ad1-a88a-56092401f754 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:21.474425 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5726c25f-7b43-4ad1-a88a-56092401f754 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:21.498129 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-5726c25f-7b43-4ad1-a88a-56092401f754 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lazy-loading 'flavor' on Instance uuid 119e78bd-a2a6-47e7-a670-9c7e6c50af78 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:26:21.772531 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5726c25f-7b43-4ad1-a88a-56092401f754 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "POST /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78/action" status: 202 len: 0 microversion: 2.20 time: 0.313736 Jun 23 17:26:21.773204 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 582/1143] 10.222.0.18 () {62 vars in 1318 bytes} [Thu Jun 23 17:26:21 2022] POST /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:26:21.781485 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-dd09c2b5-0dde-42e0-a187-97ddf814bb09 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:21.782096 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-dd09c2b5-0dde-42e0-a187-97ddf814bb09 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:21.789207 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dd09c2b5-0dde-42e0-a187-97ddf814bb09 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:21.789688 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dd09c2b5-0dde-42e0-a187-97ddf814bb09 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:21.790466 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dd09c2b5-0dde-42e0-a187-97ddf814bb09 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:21.790899 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dd09c2b5-0dde-42e0-a187-97ddf814bb09 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:21.929623 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-dd09c2b5-0dde-42e0-a187-97ddf814bb09 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:21.942534 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-dd09c2b5-0dde-42e0-a187-97ddf814bb09 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:21.944343 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-dd09c2b5-0dde-42e0-a187-97ddf814bb09 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:21.945488 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-dd09c2b5-0dde-42e0-a187-97ddf814bb09 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1722 microversion: 2.20 time: 0.168033 Jun 23 17:26:21.946084 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 562/1144] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:21 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:22.970217 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-19425e49-ce03-4ae4-b099-ecc27f7b40b2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:22.971173 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-19425e49-ce03-4ae4-b099-ecc27f7b40b2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:22.982596 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-19425e49-ce03-4ae4-b099-ecc27f7b40b2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:22.983375 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-19425e49-ce03-4ae4-b099-ecc27f7b40b2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:22.984621 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-19425e49-ce03-4ae4-b099-ecc27f7b40b2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:22.985329 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-19425e49-ce03-4ae4-b099-ecc27f7b40b2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:23.124351 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-19425e49-ce03-4ae4-b099-ecc27f7b40b2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:23.132810 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-19425e49-ce03-4ae4-b099-ecc27f7b40b2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:23.134327 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-19425e49-ce03-4ae4-b099-ecc27f7b40b2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:23.135470 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-19425e49-ce03-4ae4-b099-ecc27f7b40b2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1722 microversion: 2.20 time: 0.173506 Jun 23 17:26:23.136006 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 583/1145] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:22 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:24.158385 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-210068ee-02a0-4001-babc-f7da8b555838 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:24.159473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-210068ee-02a0-4001-babc-f7da8b555838 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:24.167713 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-210068ee-02a0-4001-babc-f7da8b555838 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:24.168157 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-210068ee-02a0-4001-babc-f7da8b555838 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:24.168916 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-210068ee-02a0-4001-babc-f7da8b555838 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:24.169361 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-210068ee-02a0-4001-babc-f7da8b555838 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:24.313742 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-210068ee-02a0-4001-babc-f7da8b555838 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:24.322273 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-210068ee-02a0-4001-babc-f7da8b555838 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:24.323764 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-210068ee-02a0-4001-babc-f7da8b555838 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:24.324907 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-210068ee-02a0-4001-babc-f7da8b555838 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1722 microversion: 2.20 time: 0.173154 Jun 23 17:26:24.325466 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 563/1146] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:24 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:25.347201 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-10bcf637-579b-45c6-9ea6-0cb774e5e0a8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:25.348203 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-10bcf637-579b-45c6-9ea6-0cb774e5e0a8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:25.359654 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-10bcf637-579b-45c6-9ea6-0cb774e5e0a8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:25.360392 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-10bcf637-579b-45c6-9ea6-0cb774e5e0a8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:25.361649 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-10bcf637-579b-45c6-9ea6-0cb774e5e0a8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:25.362452 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-10bcf637-579b-45c6-9ea6-0cb774e5e0a8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:25.505418 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-10bcf637-579b-45c6-9ea6-0cb774e5e0a8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:25.514147 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-10bcf637-579b-45c6-9ea6-0cb774e5e0a8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:25.515650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-10bcf637-579b-45c6-9ea6-0cb774e5e0a8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:25.516814 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-10bcf637-579b-45c6-9ea6-0cb774e5e0a8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1722 microversion: 2.20 time: 0.176203 Jun 23 17:26:25.517377 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 584/1147] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:25 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:26.538829 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d09becf7-d8d7-4faf-9026-c619bef3d3ca tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:26.539464 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d09becf7-d8d7-4faf-9026-c619bef3d3ca tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:26.546567 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d09becf7-d8d7-4faf-9026-c619bef3d3ca tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:26.547087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d09becf7-d8d7-4faf-9026-c619bef3d3ca tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:26.547844 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d09becf7-d8d7-4faf-9026-c619bef3d3ca tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:26.548269 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d09becf7-d8d7-4faf-9026-c619bef3d3ca tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:26.693297 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d09becf7-d8d7-4faf-9026-c619bef3d3ca tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:26.702123 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d09becf7-d8d7-4faf-9026-c619bef3d3ca tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:26.703613 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d09becf7-d8d7-4faf-9026-c619bef3d3ca tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:26.704758 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d09becf7-d8d7-4faf-9026-c619bef3d3ca tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1722 microversion: 2.20 time: 0.171602 Jun 23 17:26:26.705311 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 564/1148] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:26 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:27.723989 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-94c7f458-5eb0-4eba-a4b2-2f5e702f5eab tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:27.724593 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-94c7f458-5eb0-4eba-a4b2-2f5e702f5eab tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:27.731524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-94c7f458-5eb0-4eba-a4b2-2f5e702f5eab tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:27.731963 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-94c7f458-5eb0-4eba-a4b2-2f5e702f5eab tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:27.732706 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-94c7f458-5eb0-4eba-a4b2-2f5e702f5eab tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:27.733134 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-94c7f458-5eb0-4eba-a4b2-2f5e702f5eab tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:27.872929 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-94c7f458-5eb0-4eba-a4b2-2f5e702f5eab tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:27.881103 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-94c7f458-5eb0-4eba-a4b2-2f5e702f5eab tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:27.882647 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-94c7f458-5eb0-4eba-a4b2-2f5e702f5eab tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:27.883801 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-94c7f458-5eb0-4eba-a4b2-2f5e702f5eab tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1722 microversion: 2.20 time: 0.163839 Jun 23 17:26:27.884341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 585/1149] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:27 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:28.906578 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b0e2c100-f49b-4994-8449-788f411d4928 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:28.907499 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b0e2c100-f49b-4994-8449-788f411d4928 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:28.918548 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0e2c100-f49b-4994-8449-788f411d4928 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:28.919276 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0e2c100-f49b-4994-8449-788f411d4928 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:28.920552 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0e2c100-f49b-4994-8449-788f411d4928 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:28.921217 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0e2c100-f49b-4994-8449-788f411d4928 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:29.064473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b0e2c100-f49b-4994-8449-788f411d4928 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:29.073151 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b0e2c100-f49b-4994-8449-788f411d4928 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:29.074683 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b0e2c100-f49b-4994-8449-788f411d4928 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:29.075830 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b0e2c100-f49b-4994-8449-788f411d4928 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1722 microversion: 2.20 time: 0.175810 Jun 23 17:26:29.076355 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 565/1150] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:28 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:30.096910 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-81743fe2-6e5e-498f-8e51-d57eb9625641 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:30.097509 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-81743fe2-6e5e-498f-8e51-d57eb9625641 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:30.104747 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-81743fe2-6e5e-498f-8e51-d57eb9625641 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:30.105188 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-81743fe2-6e5e-498f-8e51-d57eb9625641 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:30.105968 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-81743fe2-6e5e-498f-8e51-d57eb9625641 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:30.106395 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-81743fe2-6e5e-498f-8e51-d57eb9625641 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:30.236733 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-81743fe2-6e5e-498f-8e51-d57eb9625641 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:30.245167 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-81743fe2-6e5e-498f-8e51-d57eb9625641 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:30.249824 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-81743fe2-6e5e-498f-8e51-d57eb9625641 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:30.251235 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-81743fe2-6e5e-498f-8e51-d57eb9625641 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1722 microversion: 2.20 time: 0.158306 Jun 23 17:26:30.251771 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 586/1151] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:30 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:31.273072 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-49ae3a92-a2de-4ead-b571-849806de5cfd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:31.273820 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-49ae3a92-a2de-4ead-b571-849806de5cfd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:31.283257 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49ae3a92-a2de-4ead-b571-849806de5cfd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:31.283844 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49ae3a92-a2de-4ead-b571-849806de5cfd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:31.284881 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49ae3a92-a2de-4ead-b571-849806de5cfd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:31.285448 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49ae3a92-a2de-4ead-b571-849806de5cfd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:31.426162 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-49ae3a92-a2de-4ead-b571-849806de5cfd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:31.435345 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-49ae3a92-a2de-4ead-b571-849806de5cfd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:31.436829 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-49ae3a92-a2de-4ead-b571-849806de5cfd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:31.438016 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-49ae3a92-a2de-4ead-b571-849806de5cfd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1722 microversion: 2.20 time: 0.171383 Jun 23 17:26:31.438576 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 566/1152] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:31 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:32.467045 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-8903c103-f448-42af-b3dc-20c4be0d2c25 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:32.468642 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-8903c103-f448-42af-b3dc-20c4be0d2c25 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:32.478105 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8903c103-f448-42af-b3dc-20c4be0d2c25 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:32.478549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8903c103-f448-42af-b3dc-20c4be0d2c25 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:32.479306 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8903c103-f448-42af-b3dc-20c4be0d2c25 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:32.479742 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8903c103-f448-42af-b3dc-20c4be0d2c25 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:32.628805 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-8903c103-f448-42af-b3dc-20c4be0d2c25 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:32.637338 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-8903c103-f448-42af-b3dc-20c4be0d2c25 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:32.638871 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-8903c103-f448-42af-b3dc-20c4be0d2c25 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:32.640019 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-8903c103-f448-42af-b3dc-20c4be0d2c25 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1722 microversion: 2.20 time: 0.179690 Jun 23 17:26:32.640622 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 587/1153] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:32 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:33.663181 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-03a5f6cd-ff18-4877-9cb0-a29af92dcf49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:33.664173 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-03a5f6cd-ff18-4877-9cb0-a29af92dcf49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:33.675219 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-03a5f6cd-ff18-4877-9cb0-a29af92dcf49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:33.675955 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-03a5f6cd-ff18-4877-9cb0-a29af92dcf49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:33.677197 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-03a5f6cd-ff18-4877-9cb0-a29af92dcf49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:33.678089 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-03a5f6cd-ff18-4877-9cb0-a29af92dcf49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:33.812921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-03a5f6cd-ff18-4877-9cb0-a29af92dcf49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:33.821421 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-03a5f6cd-ff18-4877-9cb0-a29af92dcf49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:33.822964 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-03a5f6cd-ff18-4877-9cb0-a29af92dcf49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:33.824124 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-03a5f6cd-ff18-4877-9cb0-a29af92dcf49 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1743 microversion: 2.20 time: 0.167855 Jun 23 17:26:33.824690 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 567/1154] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:33 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:34.843613 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-445f2e3b-a9d7-4687-834d-df0236bd7947 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:34.844214 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-445f2e3b-a9d7-4687-834d-df0236bd7947 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:34.852599 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-445f2e3b-a9d7-4687-834d-df0236bd7947 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:34.853147 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-445f2e3b-a9d7-4687-834d-df0236bd7947 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:34.854170 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-445f2e3b-a9d7-4687-834d-df0236bd7947 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:34.854706 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-445f2e3b-a9d7-4687-834d-df0236bd7947 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:34.998653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-445f2e3b-a9d7-4687-834d-df0236bd7947 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:35.011048 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-445f2e3b-a9d7-4687-834d-df0236bd7947 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:35.013246 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-445f2e3b-a9d7-4687-834d-df0236bd7947 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:35.014900 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-445f2e3b-a9d7-4687-834d-df0236bd7947 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1743 microversion: 2.20 time: 0.175134 Jun 23 17:26:35.015669 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 588/1155] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:34 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:36.036351 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8311d33e-6d64-4cfc-a74c-b53f678b880f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:36.036930 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8311d33e-6d64-4cfc-a74c-b53f678b880f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:36.044178 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8311d33e-6d64-4cfc-a74c-b53f678b880f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:36.044631 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8311d33e-6d64-4cfc-a74c-b53f678b880f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:36.045355 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8311d33e-6d64-4cfc-a74c-b53f678b880f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:36.045782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8311d33e-6d64-4cfc-a74c-b53f678b880f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:36.177847 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8311d33e-6d64-4cfc-a74c-b53f678b880f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:36.187337 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8311d33e-6d64-4cfc-a74c-b53f678b880f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:36.188918 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8311d33e-6d64-4cfc-a74c-b53f678b880f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:36.190110 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8311d33e-6d64-4cfc-a74c-b53f678b880f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1743 microversion: 2.20 time: 0.157846 Jun 23 17:26:36.190680 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 568/1156] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:36 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:37.213032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7d42dd47-11be-4179-8e6e-a5c9bb7bf512 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:37.213665 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7d42dd47-11be-4179-8e6e-a5c9bb7bf512 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:37.220734 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d42dd47-11be-4179-8e6e-a5c9bb7bf512 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:37.221174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d42dd47-11be-4179-8e6e-a5c9bb7bf512 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:37.221969 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d42dd47-11be-4179-8e6e-a5c9bb7bf512 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:37.222399 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7d42dd47-11be-4179-8e6e-a5c9bb7bf512 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:37.359505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7d42dd47-11be-4179-8e6e-a5c9bb7bf512 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:37.368082 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7d42dd47-11be-4179-8e6e-a5c9bb7bf512 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:37.369584 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7d42dd47-11be-4179-8e6e-a5c9bb7bf512 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:37.370772 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7d42dd47-11be-4179-8e6e-a5c9bb7bf512 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1743 microversion: 2.20 time: 0.164330 Jun 23 17:26:37.371304 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 589/1157] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:37 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:38.069202 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-bd0f7dff-9a2e-43c2-a35c-05da62a13d6a req-57a655c2-478b-469f-8b72-fee8cfd20258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119e78bd-a2a6-47e7-a670-9c7e6c50af78", "name": "network-vif-plugged", "status": "completed", "tag": "42adbc70-d4e6-4f72-a374-033d3188ff7e"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:26:38.078736 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-bd0f7dff-9a2e-43c2-a35c-05da62a13d6a req-57a655c2-478b-469f-8b72-fee8cfd20258 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:38.079221 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-bd0f7dff-9a2e-43c2-a35c-05da62a13d6a req-57a655c2-478b-469f-8b72-fee8cfd20258 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:38.091252 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-bd0f7dff-9a2e-43c2-a35c-05da62a13d6a req-57a655c2-478b-469f-8b72-fee8cfd20258 service nova] Creating event network-vif-plugged:42adbc70-d4e6-4f72-a374-033d3188ff7e for instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 on hv-cinder-83538 Jun 23 17:26:38.096414 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-bd0f7dff-9a2e-43c2-a35c-05da62a13d6a req-57a655c2-478b-469f-8b72-fee8cfd20258 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032118 Jun 23 17:26:38.097313 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 569/1158] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:26:38.388962 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d9c6a411-5ddf-43ec-825e-7d7e5ddb350e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:38.389566 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d9c6a411-5ddf-43ec-825e-7d7e5ddb350e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:38.396437 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d9c6a411-5ddf-43ec-825e-7d7e5ddb350e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:38.396885 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d9c6a411-5ddf-43ec-825e-7d7e5ddb350e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:38.397619 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d9c6a411-5ddf-43ec-825e-7d7e5ddb350e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:38.398144 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d9c6a411-5ddf-43ec-825e-7d7e5ddb350e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:38.530644 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d9c6a411-5ddf-43ec-825e-7d7e5ddb350e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:38.539064 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d9c6a411-5ddf-43ec-825e-7d7e5ddb350e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:38.540614 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d9c6a411-5ddf-43ec-825e-7d7e5ddb350e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:38.541827 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d9c6a411-5ddf-43ec-825e-7d7e5ddb350e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1738 microversion: 2.20 time: 0.156867 Jun 23 17:26:38.542401 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 590/1159] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:38 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:39.562484 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7f069530-112c-4130-a8a2-15dad0c7a028 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:39.563912 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7f069530-112c-4130-a8a2-15dad0c7a028 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:39.571037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7f069530-112c-4130-a8a2-15dad0c7a028 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:39.571600 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7f069530-112c-4130-a8a2-15dad0c7a028 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:39.572390 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7f069530-112c-4130-a8a2-15dad0c7a028 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:39.572832 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7f069530-112c-4130-a8a2-15dad0c7a028 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:39.738548 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7f069530-112c-4130-a8a2-15dad0c7a028 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:39.747346 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7f069530-112c-4130-a8a2-15dad0c7a028 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:39.748628 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7f069530-112c-4130-a8a2-15dad0c7a028 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:39.749817 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7f069530-112c-4130-a8a2-15dad0c7a028 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1738 microversion: 2.20 time: 0.192845 Jun 23 17:26:39.750381 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 570/1160] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:39 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:40.768371 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-cbfa3c80-f3d7-49ec-bed2-dff0067932f9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:40.768998 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-cbfa3c80-f3d7-49ec-bed2-dff0067932f9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:40.776038 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cbfa3c80-f3d7-49ec-bed2-dff0067932f9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:40.776505 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cbfa3c80-f3d7-49ec-bed2-dff0067932f9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:40.777268 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cbfa3c80-f3d7-49ec-bed2-dff0067932f9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:40.777697 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-cbfa3c80-f3d7-49ec-bed2-dff0067932f9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:40.931055 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-cbfa3c80-f3d7-49ec-bed2-dff0067932f9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:40.942340 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-cbfa3c80-f3d7-49ec-bed2-dff0067932f9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:40.943769 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-cbfa3c80-f3d7-49ec-bed2-dff0067932f9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:40.945415 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-cbfa3c80-f3d7-49ec-bed2-dff0067932f9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1738 microversion: 2.20 time: 0.181066 Jun 23 17:26:40.946045 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 591/1161] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:40 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:41.966100 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1099ac6a-c7fb-4fa3-b8fb-1a7d5666c997 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:41.966937 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1099ac6a-c7fb-4fa3-b8fb-1a7d5666c997 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:41.974733 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1099ac6a-c7fb-4fa3-b8fb-1a7d5666c997 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:41.976695 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1099ac6a-c7fb-4fa3-b8fb-1a7d5666c997 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:41.976695 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1099ac6a-c7fb-4fa3-b8fb-1a7d5666c997 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:41.976695 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1099ac6a-c7fb-4fa3-b8fb-1a7d5666c997 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:42.125398 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1099ac6a-c7fb-4fa3-b8fb-1a7d5666c997 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:42.136054 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1099ac6a-c7fb-4fa3-b8fb-1a7d5666c997 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:42.137743 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1099ac6a-c7fb-4fa3-b8fb-1a7d5666c997 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:42.138984 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1099ac6a-c7fb-4fa3-b8fb-1a7d5666c997 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1738 microversion: 2.20 time: 0.178687 Jun 23 17:26:42.149596 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 571/1162] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:41 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:43.157518 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-85c98eb4-64b8-4816-81db-f6f13df4fa50 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:43.158284 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-85c98eb4-64b8-4816-81db-f6f13df4fa50 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:43.165921 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-85c98eb4-64b8-4816-81db-f6f13df4fa50 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:43.166459 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-85c98eb4-64b8-4816-81db-f6f13df4fa50 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:43.167598 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-85c98eb4-64b8-4816-81db-f6f13df4fa50 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:43.168043 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-85c98eb4-64b8-4816-81db-f6f13df4fa50 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:43.321246 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-85c98eb4-64b8-4816-81db-f6f13df4fa50 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:43.331987 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-85c98eb4-64b8-4816-81db-f6f13df4fa50 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:43.333589 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-85c98eb4-64b8-4816-81db-f6f13df4fa50 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:43.334924 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-85c98eb4-64b8-4816-81db-f6f13df4fa50 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1738 microversion: 2.20 time: 0.181568 Jun 23 17:26:43.335697 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 592/1163] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:43 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:44.358137 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3731ec21-4dee-48bf-8492-6b8f2e13a99a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:44.359482 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3731ec21-4dee-48bf-8492-6b8f2e13a99a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:44.366929 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3731ec21-4dee-48bf-8492-6b8f2e13a99a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:44.367496 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3731ec21-4dee-48bf-8492-6b8f2e13a99a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:44.368282 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3731ec21-4dee-48bf-8492-6b8f2e13a99a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:44.368720 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3731ec21-4dee-48bf-8492-6b8f2e13a99a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:44.524642 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3731ec21-4dee-48bf-8492-6b8f2e13a99a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:44.534186 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3731ec21-4dee-48bf-8492-6b8f2e13a99a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:44.535705 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3731ec21-4dee-48bf-8492-6b8f2e13a99a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:44.536929 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3731ec21-4dee-48bf-8492-6b8f2e13a99a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1738 microversion: 2.20 time: 0.182867 Jun 23 17:26:44.537835 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 572/1164] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:44 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:45.556974 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f52c4ab5-167a-4d1a-b173-6858beab95b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:45.558321 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f52c4ab5-167a-4d1a-b173-6858beab95b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:45.565928 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f52c4ab5-167a-4d1a-b173-6858beab95b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:45.566637 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f52c4ab5-167a-4d1a-b173-6858beab95b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:45.567657 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f52c4ab5-167a-4d1a-b173-6858beab95b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:45.568179 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f52c4ab5-167a-4d1a-b173-6858beab95b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:45.720237 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f52c4ab5-167a-4d1a-b173-6858beab95b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:45.729764 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f52c4ab5-167a-4d1a-b173-6858beab95b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:45.731464 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f52c4ab5-167a-4d1a-b173-6858beab95b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:45.732709 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f52c4ab5-167a-4d1a-b173-6858beab95b3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1738 microversion: 2.20 time: 0.180047 Jun 23 17:26:45.733521 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 593/1165] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:45 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:46.752165 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-587a62b7-c370-4155-a63a-8b38c209a484 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:46.753460 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-587a62b7-c370-4155-a63a-8b38c209a484 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:46.760725 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-587a62b7-c370-4155-a63a-8b38c209a484 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:46.761173 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-587a62b7-c370-4155-a63a-8b38c209a484 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:46.761968 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-587a62b7-c370-4155-a63a-8b38c209a484 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:46.762401 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-587a62b7-c370-4155-a63a-8b38c209a484 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:46.912563 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-587a62b7-c370-4155-a63a-8b38c209a484 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:46.921515 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-587a62b7-c370-4155-a63a-8b38c209a484 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:46.922959 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-587a62b7-c370-4155-a63a-8b38c209a484 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:46.924121 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-587a62b7-c370-4155-a63a-8b38c209a484 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1738 microversion: 2.20 time: 0.175966 Jun 23 17:26:46.924686 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 573/1166] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:46 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:47.942601 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-986d3fbc-5108-4b3c-b7b4-b90212b7f427 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:47.943174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-986d3fbc-5108-4b3c-b7b4-b90212b7f427 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:47.949960 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-986d3fbc-5108-4b3c-b7b4-b90212b7f427 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:47.950402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-986d3fbc-5108-4b3c-b7b4-b90212b7f427 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:47.951153 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-986d3fbc-5108-4b3c-b7b4-b90212b7f427 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:47.951584 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-986d3fbc-5108-4b3c-b7b4-b90212b7f427 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:48.086864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-986d3fbc-5108-4b3c-b7b4-b90212b7f427 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:48.095011 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-986d3fbc-5108-4b3c-b7b4-b90212b7f427 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:48.096551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-986d3fbc-5108-4b3c-b7b4-b90212b7f427 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:48.097711 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-986d3fbc-5108-4b3c-b7b4-b90212b7f427 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1720 microversion: 2.20 time: 0.159221 Jun 23 17:26:48.098316 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 594/1167] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:47 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:49.119109 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-34f7b767-a8ae-401a-a335-01054316d9f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:49.119709 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-34f7b767-a8ae-401a-a335-01054316d9f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:49.126364 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-34f7b767-a8ae-401a-a335-01054316d9f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:49.126801 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-34f7b767-a8ae-401a-a335-01054316d9f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:49.127557 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-34f7b767-a8ae-401a-a335-01054316d9f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:49.127985 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-34f7b767-a8ae-401a-a335-01054316d9f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:49.266505 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-34f7b767-a8ae-401a-a335-01054316d9f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:49.274744 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-34f7b767-a8ae-401a-a335-01054316d9f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:49.276218 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-34f7b767-a8ae-401a-a335-01054316d9f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:49.277367 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-34f7b767-a8ae-401a-a335-01054316d9f4 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1720 microversion: 2.20 time: 0.163740 Jun 23 17:26:49.277954 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 574/1168] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:49 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:50.299838 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6103e130-f43a-4241-bc59-820c928a85b8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:50.300778 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6103e130-f43a-4241-bc59-820c928a85b8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:50.312421 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6103e130-f43a-4241-bc59-820c928a85b8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:50.313166 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6103e130-f43a-4241-bc59-820c928a85b8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:50.314483 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6103e130-f43a-4241-bc59-820c928a85b8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:50.315202 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6103e130-f43a-4241-bc59-820c928a85b8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:50.453588 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6103e130-f43a-4241-bc59-820c928a85b8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:50.461564 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6103e130-f43a-4241-bc59-820c928a85b8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:50.463297 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6103e130-f43a-4241-bc59-820c928a85b8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:50.464441 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6103e130-f43a-4241-bc59-820c928a85b8 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1723 microversion: 2.20 time: 0.171345 Jun 23 17:26:50.465006 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 595/1169] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:50 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:50.482077 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-304f7954-3bfa-4167-936f-1fe815489c14 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bebb8b68-1456-497f-8256-2725864dd097"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:26:50.483145 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-304f7954-3bfa-4167-936f-1fe815489c14 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:50.485593 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=29 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:26:50.490962 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-304f7954-3bfa-4167-936f-1fe815489c14 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:50.491409 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-304f7954-3bfa-4167-936f-1fe815489c14 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:50.492169 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-304f7954-3bfa-4167-936f-1fe815489c14 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:50.492601 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-304f7954-3bfa-4167-936f-1fe815489c14 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:50.495562 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=79 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:26:50.778124 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-304f7954-3bfa-4167-936f-1fe815489c14 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "POST /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300124 Jun 23 17:26:50.778703 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 575/1170] 10.222.0.18 () {62 vars in 1363 bytes} [Thu Jun 23 17:26:50 2022] POST /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 17:26:50.893837 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-ab411049-7f9e-44e7-85d0-737a6bbd7ea3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:50.894385 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-ab411049-7f9e-44e7-85d0-737a6bbd7ea3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:50.900935 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ab411049-7f9e-44e7-85d0-737a6bbd7ea3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:50.901373 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ab411049-7f9e-44e7-85d0-737a6bbd7ea3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:50.902153 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ab411049-7f9e-44e7-85d0-737a6bbd7ea3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:50.902578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-ab411049-7f9e-44e7-85d0-737a6bbd7ea3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:50.923125 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:26:51.170924 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-ab411049-7f9e-44e7-85d0-737a6bbd7ea3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78/os-volume_attachments/bebb8b68-1456-497f-8256-2725864dd097" status: 202 len: 0 microversion: 2.20 time: 0.281123 Jun 23 17:26:51.171551 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 596/1171] 10.222.0.18 () {60 vars in 1456 bytes} [Thu Jun 23 17:26:50 2022] DELETE /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78/os-volume_attachments/bebb8b68-1456-497f-8256-2725864dd097 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:26:51.226359 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-793a2c55-1242-4e7c-84a5-cfbe6b37b7e1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:26:51.226928 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-793a2c55-1242-4e7c-84a5-cfbe6b37b7e1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:51.233514 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-793a2c55-1242-4e7c-84a5-cfbe6b37b7e1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:51.233997 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-793a2c55-1242-4e7c-84a5-cfbe6b37b7e1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:51.234758 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-793a2c55-1242-4e7c-84a5-cfbe6b37b7e1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:51.235188 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-793a2c55-1242-4e7c-84a5-cfbe6b37b7e1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:51.329978 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-793a2c55-1242-4e7c-84a5-cfbe6b37b7e1 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "POST /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78/action" status: 202 len: 0 microversion: 2.20 time: 0.107620 Jun 23 17:26:51.330583 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 576/1172] 10.222.0.18 () {62 vars in 1318 bytes} [Thu Jun 23 17:26:51 2022] POST /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:26:51.339026 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-78bed16d-0eee-4269-9cfd-375925d1d3a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:51.340289 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-78bed16d-0eee-4269-9cfd-375925d1d3a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:51.348170 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-78bed16d-0eee-4269-9cfd-375925d1d3a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:51.348614 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-78bed16d-0eee-4269-9cfd-375925d1d3a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:51.349422 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-78bed16d-0eee-4269-9cfd-375925d1d3a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:51.349921 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-78bed16d-0eee-4269-9cfd-375925d1d3a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:51.510991 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-78bed16d-0eee-4269-9cfd-375925d1d3a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:51.519272 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-78bed16d-0eee-4269-9cfd-375925d1d3a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:51.520788 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-78bed16d-0eee-4269-9cfd-375925d1d3a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:51.522017 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-78bed16d-0eee-4269-9cfd-375925d1d3a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1671 microversion: 2.20 time: 0.187020 Jun 23 17:26:51.522559 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 597/1173] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:51 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1671 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 17:26:52.126510 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-9c124254-2af7-4f03-a848-915f74175e50 req-9ca57ef7-2fd9-427d-b3f2-c20cba2738b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119e78bd-a2a6-47e7-a670-9c7e6c50af78", "name": "network-vif-unplugged", "status": "completed", "tag": "42adbc70-d4e6-4f72-a374-033d3188ff7e"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:26:52.136064 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9c124254-2af7-4f03-a848-915f74175e50 req-9ca57ef7-2fd9-427d-b3f2-c20cba2738b8 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:52.136546 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9c124254-2af7-4f03-a848-915f74175e50 req-9ca57ef7-2fd9-427d-b3f2-c20cba2738b8 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:52.149308 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.compute.server_external_events [req-9c124254-2af7-4f03-a848-915f74175e50 req-9ca57ef7-2fd9-427d-b3f2-c20cba2738b8 service nova] Unable to find a host for instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78. Dropping event network-vif-unplugged {{(pid=117896) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 17:26:52.150314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-9c124254-2af7-4f03-a848-915f74175e50 req-9ca57ef7-2fd9-427d-b3f2-c20cba2738b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028350 Jun 23 17:26:52.150900 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 577/1174] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 23 17:26:52.543097 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d258aa6a-84ab-4e58-b1a7-4b8b725505c3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:52.543701 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d258aa6a-84ab-4e58-b1a7-4b8b725505c3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:52.546215 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=33 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:26:52.552460 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d258aa6a-84ab-4e58-b1a7-4b8b725505c3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:52.552903 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d258aa6a-84ab-4e58-b1a7-4b8b725505c3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:52.553664 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d258aa6a-84ab-4e58-b1a7-4b8b725505c3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:52.554115 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d258aa6a-84ab-4e58-b1a7-4b8b725505c3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:52.690146 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d258aa6a-84ab-4e58-b1a7-4b8b725505c3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:52.698700 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d258aa6a-84ab-4e58-b1a7-4b8b725505c3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:52.700189 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d258aa6a-84ab-4e58-b1a7-4b8b725505c3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:52.701401 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d258aa6a-84ab-4e58-b1a7-4b8b725505c3 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1671 microversion: 2.20 time: 0.163418 Jun 23 17:26:52.701967 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 598/1175] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:52 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:53.719825 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-162a43c5-b518-4554-9b2f-9e127a0218d2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:53.720427 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-162a43c5-b518-4554-9b2f-9e127a0218d2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:53.727542 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-162a43c5-b518-4554-9b2f-9e127a0218d2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:53.727653 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-162a43c5-b518-4554-9b2f-9e127a0218d2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:53.728393 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-162a43c5-b518-4554-9b2f-9e127a0218d2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:53.728823 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-162a43c5-b518-4554-9b2f-9e127a0218d2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:53.868712 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-162a43c5-b518-4554-9b2f-9e127a0218d2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:53.877531 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-162a43c5-b518-4554-9b2f-9e127a0218d2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:53.879087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-162a43c5-b518-4554-9b2f-9e127a0218d2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:53.880248 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-162a43c5-b518-4554-9b2f-9e127a0218d2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1671 microversion: 2.20 time: 0.164349 Jun 23 17:26:53.880816 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 578/1176] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:53 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:54.527988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:26:54.528400 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Thu Jun 23 17:26:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:26:54.903254 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-77820719-aa7e-44b6-a1af-dfac21ad96e7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:54.904226 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-77820719-aa7e-44b6-a1af-dfac21ad96e7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:54.915387 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-77820719-aa7e-44b6-a1af-dfac21ad96e7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:54.915827 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-77820719-aa7e-44b6-a1af-dfac21ad96e7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:54.916579 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-77820719-aa7e-44b6-a1af-dfac21ad96e7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:54.917008 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-77820719-aa7e-44b6-a1af-dfac21ad96e7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:55.067562 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-77820719-aa7e-44b6-a1af-dfac21ad96e7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:55.076211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-77820719-aa7e-44b6-a1af-dfac21ad96e7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:55.077688 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-77820719-aa7e-44b6-a1af-dfac21ad96e7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:55.078848 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-77820719-aa7e-44b6-a1af-dfac21ad96e7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1671 microversion: 2.20 time: 0.182511 Jun 23 17:26:55.079416 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 599/1177] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:54 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1671 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:56.097257 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-31fa56a2-fb31-4eb1-a9e3-db736353ca45 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:56.098055 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-31fa56a2-fb31-4eb1-a9e3-db736353ca45 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:56.105326 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-31fa56a2-fb31-4eb1-a9e3-db736353ca45 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:56.105774 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-31fa56a2-fb31-4eb1-a9e3-db736353ca45 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:56.106574 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-31fa56a2-fb31-4eb1-a9e3-db736353ca45 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:56.107013 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-31fa56a2-fb31-4eb1-a9e3-db736353ca45 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:56.258463 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-31fa56a2-fb31-4eb1-a9e3-db736353ca45 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:56.267523 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-31fa56a2-fb31-4eb1-a9e3-db736353ca45 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:56.269016 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-31fa56a2-fb31-4eb1-a9e3-db736353ca45 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:56.270271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-31fa56a2-fb31-4eb1-a9e3-db736353ca45 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.177143 Jun 23 17:26:56.270833 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 579/1178] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:56 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:57.288611 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3d655771-b49b-474e-a0da-896d7cd27c13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:57.289217 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3d655771-b49b-474e-a0da-896d7cd27c13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:57.296236 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d655771-b49b-474e-a0da-896d7cd27c13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:57.296679 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d655771-b49b-474e-a0da-896d7cd27c13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:57.297463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d655771-b49b-474e-a0da-896d7cd27c13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:57.297927 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3d655771-b49b-474e-a0da-896d7cd27c13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:57.495460 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3d655771-b49b-474e-a0da-896d7cd27c13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:57.506877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3d655771-b49b-474e-a0da-896d7cd27c13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:57.509280 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-3d655771-b49b-474e-a0da-896d7cd27c13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:57.510797 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3d655771-b49b-474e-a0da-896d7cd27c13 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.226084 Jun 23 17:26:57.524219 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 600/1179] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:57 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:58.531313 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7bc98e07-abc0-4c31-8fd9-de8c192e9a41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:58.531934 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7bc98e07-abc0-4c31-8fd9-de8c192e9a41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:58.541065 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7bc98e07-abc0-4c31-8fd9-de8c192e9a41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:58.541466 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7bc98e07-abc0-4c31-8fd9-de8c192e9a41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:58.542269 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7bc98e07-abc0-4c31-8fd9-de8c192e9a41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:58.543117 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7bc98e07-abc0-4c31-8fd9-de8c192e9a41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:58.684465 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7bc98e07-abc0-4c31-8fd9-de8c192e9a41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:58.707748 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7bc98e07-abc0-4c31-8fd9-de8c192e9a41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:58.709251 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7bc98e07-abc0-4c31-8fd9-de8c192e9a41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:58.710542 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7bc98e07-abc0-4c31-8fd9-de8c192e9a41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.184485 Jun 23 17:26:58.711106 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 580/1180] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:58 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:26:59.728748 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5dc50eec-47a6-4f45-a74b-6fdb3d787ba7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:26:59.729408 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5dc50eec-47a6-4f45-a74b-6fdb3d787ba7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:26:59.737099 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5dc50eec-47a6-4f45-a74b-6fdb3d787ba7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:59.737553 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5dc50eec-47a6-4f45-a74b-6fdb3d787ba7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:59.738357 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5dc50eec-47a6-4f45-a74b-6fdb3d787ba7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:26:59.738791 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5dc50eec-47a6-4f45-a74b-6fdb3d787ba7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:26:59.911669 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5dc50eec-47a6-4f45-a74b-6fdb3d787ba7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:59.921125 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5dc50eec-47a6-4f45-a74b-6fdb3d787ba7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:59.922851 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-5dc50eec-47a6-4f45-a74b-6fdb3d787ba7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:26:59.924030 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5dc50eec-47a6-4f45-a74b-6fdb3d787ba7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.199258 Jun 23 17:26:59.924592 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 601/1181] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:26:59 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:00.942965 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-455cf7f4-304d-4907-a89c-c21a9a11e29e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:00.943553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-455cf7f4-304d-4907-a89c-c21a9a11e29e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:00.950760 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-455cf7f4-304d-4907-a89c-c21a9a11e29e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:00.951445 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-455cf7f4-304d-4907-a89c-c21a9a11e29e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:00.952243 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-455cf7f4-304d-4907-a89c-c21a9a11e29e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:00.952710 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-455cf7f4-304d-4907-a89c-c21a9a11e29e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:01.092536 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-455cf7f4-304d-4907-a89c-c21a9a11e29e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:01.100563 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-455cf7f4-304d-4907-a89c-c21a9a11e29e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:01.102055 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-455cf7f4-304d-4907-a89c-c21a9a11e29e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:01.103212 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-455cf7f4-304d-4907-a89c-c21a9a11e29e tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.164254 Jun 23 17:27:01.103772 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 581/1182] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:00 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:02.125002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fb64d273-f60f-48e8-b361-94866d8f4643 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:02.126286 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fb64d273-f60f-48e8-b361-94866d8f4643 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:02.137831 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fb64d273-f60f-48e8-b361-94866d8f4643 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:02.138834 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fb64d273-f60f-48e8-b361-94866d8f4643 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:02.139393 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fb64d273-f60f-48e8-b361-94866d8f4643 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:02.139895 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fb64d273-f60f-48e8-b361-94866d8f4643 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:02.280963 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-fb64d273-f60f-48e8-b361-94866d8f4643 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:02.289990 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-fb64d273-f60f-48e8-b361-94866d8f4643 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:02.291807 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-fb64d273-f60f-48e8-b361-94866d8f4643 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:02.292978 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-fb64d273-f60f-48e8-b361-94866d8f4643 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.175960 Jun 23 17:27:02.293548 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 602/1183] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:02 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:03.313516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-43719747-e784-4937-ae98-61018507de8a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:03.315435 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-43719747-e784-4937-ae98-61018507de8a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:03.323619 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43719747-e784-4937-ae98-61018507de8a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:03.324409 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43719747-e784-4937-ae98-61018507de8a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:03.325425 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43719747-e784-4937-ae98-61018507de8a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:03.326126 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43719747-e784-4937-ae98-61018507de8a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:03.477758 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-43719747-e784-4937-ae98-61018507de8a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:03.494148 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-43719747-e784-4937-ae98-61018507de8a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:03.497176 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-43719747-e784-4937-ae98-61018507de8a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:03.499449 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-43719747-e784-4937-ae98-61018507de8a tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.190693 Jun 23 17:27:03.510517 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 582/1184] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:03 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:04.518417 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7406707f-d9e9-4d65-8cf7-f2d919455db9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:04.519844 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7406707f-d9e9-4d65-8cf7-f2d919455db9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:04.527578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7406707f-d9e9-4d65-8cf7-f2d919455db9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:04.528412 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7406707f-d9e9-4d65-8cf7-f2d919455db9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:04.529491 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7406707f-d9e9-4d65-8cf7-f2d919455db9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:04.530663 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7406707f-d9e9-4d65-8cf7-f2d919455db9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:04.672034 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7406707f-d9e9-4d65-8cf7-f2d919455db9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:04.680877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7406707f-d9e9-4d65-8cf7-f2d919455db9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:04.682484 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7406707f-d9e9-4d65-8cf7-f2d919455db9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:04.683729 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7406707f-d9e9-4d65-8cf7-f2d919455db9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.169353 Jun 23 17:27:04.684945 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 603/1185] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:04 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:05.704736 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bc9dc679-b036-4c33-9b2c-815c8179dfd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:05.705471 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bc9dc679-b036-4c33-9b2c-815c8179dfd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:05.713600 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bc9dc679-b036-4c33-9b2c-815c8179dfd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:05.714155 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bc9dc679-b036-4c33-9b2c-815c8179dfd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:05.715040 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bc9dc679-b036-4c33-9b2c-815c8179dfd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:05.715542 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bc9dc679-b036-4c33-9b2c-815c8179dfd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:05.864147 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bc9dc679-b036-4c33-9b2c-815c8179dfd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:05.872233 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bc9dc679-b036-4c33-9b2c-815c8179dfd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:05.873838 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bc9dc679-b036-4c33-9b2c-815c8179dfd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:05.875077 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bc9dc679-b036-4c33-9b2c-815c8179dfd9 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.175112 Jun 23 17:27:05.875646 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 583/1186] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:05 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:06.897025 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-51a69412-ec35-4f77-a752-2164ab160257 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:06.898078 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-51a69412-ec35-4f77-a752-2164ab160257 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:06.909392 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-51a69412-ec35-4f77-a752-2164ab160257 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:06.910205 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-51a69412-ec35-4f77-a752-2164ab160257 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:06.911449 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-51a69412-ec35-4f77-a752-2164ab160257 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:06.912183 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-51a69412-ec35-4f77-a752-2164ab160257 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:07.054141 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-51a69412-ec35-4f77-a752-2164ab160257 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:07.064769 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-51a69412-ec35-4f77-a752-2164ab160257 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:07.066272 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-51a69412-ec35-4f77-a752-2164ab160257 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:07.067405 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-51a69412-ec35-4f77-a752-2164ab160257 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.176924 Jun 23 17:27:07.067977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 604/1187] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:06 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:08.090323 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d459d068-1853-4bb7-a2ab-6730da722edd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:08.091282 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d459d068-1853-4bb7-a2ab-6730da722edd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:08.102545 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d459d068-1853-4bb7-a2ab-6730da722edd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:08.103286 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d459d068-1853-4bb7-a2ab-6730da722edd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:08.104519 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d459d068-1853-4bb7-a2ab-6730da722edd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:08.105227 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d459d068-1853-4bb7-a2ab-6730da722edd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:08.251308 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d459d068-1853-4bb7-a2ab-6730da722edd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:08.259719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d459d068-1853-4bb7-a2ab-6730da722edd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:08.261211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d459d068-1853-4bb7-a2ab-6730da722edd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:08.262396 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d459d068-1853-4bb7-a2ab-6730da722edd tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.178677 Jun 23 17:27:08.262959 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 584/1188] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:08 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:09.211781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:27:09.212726 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Thu Jun 23 17:27:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:27:09.282431 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-711937af-b635-45c5-8d14-4b694eae8c41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:09.283172 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-711937af-b635-45c5-8d14-4b694eae8c41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:09.291297 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-711937af-b635-45c5-8d14-4b694eae8c41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:09.291845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-711937af-b635-45c5-8d14-4b694eae8c41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:09.292775 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-711937af-b635-45c5-8d14-4b694eae8c41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:09.293307 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-711937af-b635-45c5-8d14-4b694eae8c41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:09.434996 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-711937af-b635-45c5-8d14-4b694eae8c41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:09.443293 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-711937af-b635-45c5-8d14-4b694eae8c41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:09.444800 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-711937af-b635-45c5-8d14-4b694eae8c41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:09.446001 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-711937af-b635-45c5-8d14-4b694eae8c41 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.168718 Jun 23 17:27:09.446570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 605/1189] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:09 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:10.468386 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-508b0f95-7016-489d-835e-cecad5ce9fc7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:10.469433 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-508b0f95-7016-489d-835e-cecad5ce9fc7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:10.480334 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-508b0f95-7016-489d-835e-cecad5ce9fc7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:10.481080 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-508b0f95-7016-489d-835e-cecad5ce9fc7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:10.482382 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-508b0f95-7016-489d-835e-cecad5ce9fc7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:10.483105 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-508b0f95-7016-489d-835e-cecad5ce9fc7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:10.621350 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-508b0f95-7016-489d-835e-cecad5ce9fc7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:10.629899 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-508b0f95-7016-489d-835e-cecad5ce9fc7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:10.631372 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-508b0f95-7016-489d-835e-cecad5ce9fc7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:10.632523 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-508b0f95-7016-489d-835e-cecad5ce9fc7 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.170803 Jun 23 17:27:10.633121 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 585/1190] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:10 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:11.655116 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1d30afab-f908-40b3-a801-2665a923388f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:11.656126 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1d30afab-f908-40b3-a801-2665a923388f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:11.663761 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1d30afab-f908-40b3-a801-2665a923388f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:11.664212 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1d30afab-f908-40b3-a801-2665a923388f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:11.664976 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1d30afab-f908-40b3-a801-2665a923388f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:11.665410 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1d30afab-f908-40b3-a801-2665a923388f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:11.804361 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1d30afab-f908-40b3-a801-2665a923388f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:11.815263 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1d30afab-f908-40b3-a801-2665a923388f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:11.817679 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1d30afab-f908-40b3-a801-2665a923388f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:11.819579 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1d30afab-f908-40b3-a801-2665a923388f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.170810 Jun 23 17:27:11.820395 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 606/1191] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:11 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:12.840836 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5cb390a0-b9b5-4ac9-855d-68e2af4cac00 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:12.841456 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5cb390a0-b9b5-4ac9-855d-68e2af4cac00 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:12.850214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5cb390a0-b9b5-4ac9-855d-68e2af4cac00 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:12.850662 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5cb390a0-b9b5-4ac9-855d-68e2af4cac00 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:12.851422 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5cb390a0-b9b5-4ac9-855d-68e2af4cac00 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:12.851853 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5cb390a0-b9b5-4ac9-855d-68e2af4cac00 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:12.997515 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5cb390a0-b9b5-4ac9-855d-68e2af4cac00 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:13.006269 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5cb390a0-b9b5-4ac9-855d-68e2af4cac00 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:13.007775 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5cb390a0-b9b5-4ac9-855d-68e2af4cac00 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:13.008952 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5cb390a0-b9b5-4ac9-855d-68e2af4cac00 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.172217 Jun 23 17:27:13.009500 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 586/1192] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:12 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:14.030026 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-80e38d53-f8b8-4e06-abbf-d2f23f0ef0df tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:14.030925 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-80e38d53-f8b8-4e06-abbf-d2f23f0ef0df tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:14.040917 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-80e38d53-f8b8-4e06-abbf-d2f23f0ef0df tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:14.041567 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-80e38d53-f8b8-4e06-abbf-d2f23f0ef0df tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:14.042690 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-80e38d53-f8b8-4e06-abbf-d2f23f0ef0df tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:14.043316 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-80e38d53-f8b8-4e06-abbf-d2f23f0ef0df tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:14.175683 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-80e38d53-f8b8-4e06-abbf-d2f23f0ef0df tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:14.183890 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-80e38d53-f8b8-4e06-abbf-d2f23f0ef0df tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:14.185738 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-80e38d53-f8b8-4e06-abbf-d2f23f0ef0df tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:14.186994 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-80e38d53-f8b8-4e06-abbf-d2f23f0ef0df tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.162763 Jun 23 17:27:14.187626 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 607/1193] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:14 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:14.255474 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-edbea756-22e8-45d9-b1f5-776cc07ba402 req-e98c8eb2-5c96-4b40-8da0-e5d3cc6ee630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119e78bd-a2a6-47e7-a670-9c7e6c50af78", "name": "network-vif-plugged", "status": "completed", "tag": "42adbc70-d4e6-4f72-a374-033d3188ff7e"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:27:14.264363 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-edbea756-22e8-45d9-b1f5-776cc07ba402 req-e98c8eb2-5c96-4b40-8da0-e5d3cc6ee630 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:14.264783 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-edbea756-22e8-45d9-b1f5-776cc07ba402 req-e98c8eb2-5c96-4b40-8da0-e5d3cc6ee630 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:14.276486 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-edbea756-22e8-45d9-b1f5-776cc07ba402 req-e98c8eb2-5c96-4b40-8da0-e5d3cc6ee630 service nova] Creating event network-vif-plugged:42adbc70-d4e6-4f72-a374-033d3188ff7e for instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 on hv-cinder-83538 Jun 23 17:27:14.281828 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-edbea756-22e8-45d9-b1f5-776cc07ba402 req-e98c8eb2-5c96-4b40-8da0-e5d3cc6ee630 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030220 Jun 23 17:27:14.282389 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 587/1194] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:27:15.207580 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-63e4215f-1ce6-42fe-a625-dfaee55853ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:15.208351 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-63e4215f-1ce6-42fe-a625-dfaee55853ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:15.217459 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-63e4215f-1ce6-42fe-a625-dfaee55853ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:15.218110 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-63e4215f-1ce6-42fe-a625-dfaee55853ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:15.219127 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-63e4215f-1ce6-42fe-a625-dfaee55853ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:15.219716 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-63e4215f-1ce6-42fe-a625-dfaee55853ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:15.356344 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-63e4215f-1ce6-42fe-a625-dfaee55853ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:15.365086 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-63e4215f-1ce6-42fe-a625-dfaee55853ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:15.366628 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-63e4215f-1ce6-42fe-a625-dfaee55853ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:15.367778 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-63e4215f-1ce6-42fe-a625-dfaee55853ee tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.165688 Jun 23 17:27:15.368352 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 608/1195] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:15 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:16.388509 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-590804a9-d3cd-4d34-9de9-15ba2da28ba6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:16.389454 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-590804a9-d3cd-4d34-9de9-15ba2da28ba6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:16.397004 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-590804a9-d3cd-4d34-9de9-15ba2da28ba6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:16.397444 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-590804a9-d3cd-4d34-9de9-15ba2da28ba6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:16.398250 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-590804a9-d3cd-4d34-9de9-15ba2da28ba6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:16.398677 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-590804a9-d3cd-4d34-9de9-15ba2da28ba6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:16.535395 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-590804a9-d3cd-4d34-9de9-15ba2da28ba6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:16.543629 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-590804a9-d3cd-4d34-9de9-15ba2da28ba6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:16.545252 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-590804a9-d3cd-4d34-9de9-15ba2da28ba6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:16.546528 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-590804a9-d3cd-4d34-9de9-15ba2da28ba6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1729 microversion: 2.20 time: 0.163074 Jun 23 17:27:16.547089 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 588/1196] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:16 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:27:17.568070 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-766f31fb-d2d6-46ea-9471-a57a52953c35 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:27:17.568845 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-766f31fb-d2d6-46ea-9471-a57a52953c35 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:27:17.578082 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-766f31fb-d2d6-46ea-9471-a57a52953c35 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:17.578669 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-766f31fb-d2d6-46ea-9471-a57a52953c35 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:17.579678 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-766f31fb-d2d6-46ea-9471-a57a52953c35 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:27:17.580230 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-766f31fb-d2d6-46ea-9471-a57a52953c35 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:27:17.715441 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-766f31fb-d2d6-46ea-9471-a57a52953c35 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:17.725723 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-766f31fb-d2d6-46ea-9471-a57a52953c35 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:17.727262 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-766f31fb-d2d6-46ea-9471-a57a52953c35 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:27:17.729506 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-766f31fb-d2d6-46ea-9471-a57a52953c35 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1716 microversion: 2.20 time: 0.166968 Jun 23 17:27:17.730126 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 609/1197] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:27:17 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1716 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:28:13.081620 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-581986a3-2ab3-4153-8017-c9bc6cbeccf2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:13.082590 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-581986a3-2ab3-4153-8017-c9bc6cbeccf2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:13.084758 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=29 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:13.085425 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:13.091291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-581986a3-2ab3-4153-8017-c9bc6cbeccf2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:13.091757 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-581986a3-2ab3-4153-8017-c9bc6cbeccf2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:13.092529 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-581986a3-2ab3-4153-8017-c9bc6cbeccf2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:13.092992 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-581986a3-2ab3-4153-8017-c9bc6cbeccf2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:13.125250 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-581986a3-2ab3-4153-8017-c9bc6cbeccf2 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047946 Jun 23 17:28:13.125817 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 589/1198] 10.222.0.18 () {60 vars in 1342 bytes} [Thu Jun 23 17:28:13 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:28:13.183637 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c1c250e8-1c2f-4676-b301-b76a61b0fe4c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:13.184194 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c1c250e8-1c2f-4676-b301-b76a61b0fe4c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:13.186514 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=23 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:13.187177 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:13.193673 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c1c250e8-1c2f-4676-b301-b76a61b0fe4c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:13.194156 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c1c250e8-1c2f-4676-b301-b76a61b0fe4c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:13.194906 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c1c250e8-1c2f-4676-b301-b76a61b0fe4c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:13.195334 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c1c250e8-1c2f-4676-b301-b76a61b0fe4c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:13.221423 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c1c250e8-1c2f-4676-b301-b76a61b0fe4c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Going to try to terminate instance {{(pid=117897) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:28:13.306605 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c1c250e8-1c2f-4676-b301-b76a61b0fe4c tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 204 len: 0 microversion: 2.20 time: 0.126748 Jun 23 17:28:13.307205 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 610/1199] 10.222.0.18 () {60 vars in 1279 bytes} [Thu Jun 23 17:28:13 2022] DELETE /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 17:28:13.318740 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5f61a946-4f20-43cf-8ee0-6c8e896ba119 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:13.319351 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5f61a946-4f20-43cf-8ee0-6c8e896ba119 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:13.326161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f61a946-4f20-43cf-8ee0-6c8e896ba119 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:13.326581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f61a946-4f20-43cf-8ee0-6c8e896ba119 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:13.327379 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f61a946-4f20-43cf-8ee0-6c8e896ba119 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:13.327809 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f61a946-4f20-43cf-8ee0-6c8e896ba119 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:13.467784 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f61a946-4f20-43cf-8ee0-6c8e896ba119 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:13.476098 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f61a946-4f20-43cf-8ee0-6c8e896ba119 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:13.477594 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f61a946-4f20-43cf-8ee0-6c8e896ba119 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:13.478782 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5f61a946-4f20-43cf-8ee0-6c8e896ba119 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1722 microversion: 2.20 time: 0.166636 Jun 23 17:28:13.479352 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 590/1200] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:28:13 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 17:28:14.502514 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-01077c10-a497-48fe-9d09-82b89ceae881 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:14.503647 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-01077c10-a497-48fe-9d09-82b89ceae881 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:14.514790 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-01077c10-a497-48fe-9d09-82b89ceae881 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:14.515528 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-01077c10-a497-48fe-9d09-82b89ceae881 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:14.516776 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-01077c10-a497-48fe-9d09-82b89ceae881 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:14.517486 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-01077c10-a497-48fe-9d09-82b89ceae881 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:14.662127 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-01077c10-a497-48fe-9d09-82b89ceae881 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:14.675498 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-01077c10-a497-48fe-9d09-82b89ceae881 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:14.677129 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-01077c10-a497-48fe-9d09-82b89ceae881 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:14.678324 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-01077c10-a497-48fe-9d09-82b89ceae881 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1722 microversion: 2.20 time: 0.183133 Jun 23 17:28:14.678894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 611/1201] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:28:14 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 17:28:15.696898 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ca5a7185-0710-4041-a8f0-9a61decd5cc6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:15.697503 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ca5a7185-0710-4041-a8f0-9a61decd5cc6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:15.704655 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ca5a7185-0710-4041-a8f0-9a61decd5cc6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:15.705099 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ca5a7185-0710-4041-a8f0-9a61decd5cc6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:15.705885 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ca5a7185-0710-4041-a8f0-9a61decd5cc6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:15.706451 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ca5a7185-0710-4041-a8f0-9a61decd5cc6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:15.801502 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ca5a7185-0710-4041-a8f0-9a61decd5cc6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:15.811315 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ca5a7185-0710-4041-a8f0-9a61decd5cc6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:15.812808 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ca5a7185-0710-4041-a8f0-9a61decd5cc6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b43fe7da444445fbffb6158d332d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d73f7bfc184cacb49809a89563b585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:15.814002 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ca5a7185-0710-4041-a8f0-9a61decd5cc6 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 200 len: 1656 microversion: 2.20 time: 0.121176 Jun 23 17:28:15.814562 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 591/1202] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:28:15 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 1656 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 17:28:16.022924 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-8f74f576-348b-49a0-b24f-8d4f247f8d13 req-26f23fec-3559-4621-9c56-191ba70312c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119e78bd-a2a6-47e7-a670-9c7e6c50af78", "name": "network-vif-deleted", "tag": "42adbc70-d4e6-4f72-a374-033d3188ff7e"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:28:16.031266 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-8f74f576-348b-49a0-b24f-8d4f247f8d13 req-26f23fec-3559-4621-9c56-191ba70312c5 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:16.032139 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-8f74f576-348b-49a0-b24f-8d4f247f8d13 req-26f23fec-3559-4621-9c56-191ba70312c5 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:16.043172 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-8f74f576-348b-49a0-b24f-8d4f247f8d13 req-26f23fec-3559-4621-9c56-191ba70312c5 service nova] Creating event network-vif-deleted:42adbc70-d4e6-4f72-a374-033d3188ff7e for instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 on hv-cinder-83538 Jun 23 17:28:16.048535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-8f74f576-348b-49a0-b24f-8d4f247f8d13 req-26f23fec-3559-4621-9c56-191ba70312c5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030033 Jun 23 17:28:16.052367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 612/1203] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:28:16.833276 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-83df5d2c-48e2-4ce8-89ea-497da7537cda tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:16.833895 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-83df5d2c-48e2-4ce8-89ea-497da7537cda tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:16.840998 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83df5d2c-48e2-4ce8-89ea-497da7537cda tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:16.841463 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83df5d2c-48e2-4ce8-89ea-497da7537cda tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:16.842266 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83df5d2c-48e2-4ce8-89ea-497da7537cda tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:16.842692 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83df5d2c-48e2-4ce8-89ea-497da7537cda tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:16.857183 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-83df5d2c-48e2-4ce8-89ea-497da7537cda tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] HTTP exception thrown: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-83df5d2c-48e2-4ce8-89ea-497da7537cda tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Request method failure captured: Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 HTTP/1.1 Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitKDEhCPK9tkfoHLNMHQIRrqQPCKKYaJezXov2YfTbzWmyaYPrcKbmkKlwfJ7GySbnCTV3NhFoy6Iz93RK79PHDkYXIFn1ThqI4QnK6t9x1X2RwAe0RUS3Mc7a0UpX_zgAmDqWXfMD6__Bbgp3MOZ0I25bHPbKB-n3apP_ZgZkkJ9n18 Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: e2d73f7bfc184cacb49809a89563b585 Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:28:16.858946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:28:16.860637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e2d73f7bfc184cacb49809a89563b585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2d73f7bfc184cacb49809a89563b585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e2d73f7bfc184cacb49809a89563b585", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2d73f7bfc184cacb49809a89563b585"}]}] Jun 23 17:28:16.860637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:16.860637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: e2d73f7bfc184cacb49809a89563b585 Jun 23 17:28:16.860637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:16.860637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeShelveTestJSON-682111542-project Jun 23 17:28:16.860637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:28:16.860637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:28:16.860637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: 4b43fe7da444445fbffb6158d332d99d Jun 23 17:28:16.860637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeShelveTestJSON-682111542-project Jun 23 17:28:16.860637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:28:16.860637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:16.860637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '119e78bd-a2a6-47e7-a670-9c7e6c50af78'} Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:28:16.862253 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:16.864768 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:16.866256 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-83df5d2c-48e2-4ce8-89ea-497da7537cda tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Returning 404 to user: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:28:16.866256 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-83df5d2c-48e2-4ce8-89ea-497da7537cda tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 404 len: 111 microversion: 2.20 time: 0.031274 Jun 23 17:28:16.866256 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 592/1204] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:28:16 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 17:28:16.871422 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-08eeef43-31d9-4dc9-9d58-76f2fc501d34 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '.version_select at 0x7f342d9f05e0>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:16.892159 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-08eeef43-31d9-4dc9-9d58-76f2fc501d34 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941021983" status: 204 len: 0 microversion: 2.20 time: 0.025142 Jun 23 17:28:16.892853 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 613/1205] 10.222.0.18 () {60 vars in 1261 bytes} [Thu Jun 23 17:28:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941021983 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 23 17:28:18.672633 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c463691e-6278-464d-82dd-24ea47a567a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:18.673117 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c463691e-6278-464d-82dd-24ea47a567a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:18.680001 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c463691e-6278-464d-82dd-24ea47a567a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:18.680449 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c463691e-6278-464d-82dd-24ea47a567a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:18.681207 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c463691e-6278-464d-82dd-24ea47a567a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:18.681640 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c463691e-6278-464d-82dd-24ea47a567a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:18.696062 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-c463691e-6278-464d-82dd-24ea47a567a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] HTTP exception thrown: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c463691e-6278-464d-82dd-24ea47a567a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Request method failure captured: Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: DELETE /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 HTTP/1.1 Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitKDEhCPK9tkfoHLNMHQIRrqQPCKKYaJezXov2YfTbzWmyaYPrcKbmkKlwfJ7GySbnCTV3NhFoy6Iz93RK79PHDkYXIFn1ThqI4QnK6t9x1X2RwAe0RUS3Mc7a0UpX_zgAmDqWXfMD6__Bbgp3MOZ0I25bHPbKB-n3apP_ZgZkkJ9n18 Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: e2d73f7bfc184cacb49809a89563b585 Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:28:18.697616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:28:18.699392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e2d73f7bfc184cacb49809a89563b585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2d73f7bfc184cacb49809a89563b585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e2d73f7bfc184cacb49809a89563b585", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2d73f7bfc184cacb49809a89563b585"}]}] Jun 23 17:28:18.699392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:18.699392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: e2d73f7bfc184cacb49809a89563b585 Jun 23 17:28:18.699392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:18.699392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeShelveTestJSON-682111542-project Jun 23 17:28:18.699392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:28:18.699392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:28:18.699392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: 4b43fe7da444445fbffb6158d332d99d Jun 23 17:28:18.699392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeShelveTestJSON-682111542-project Jun 23 17:28:18.699392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:28:18.699392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:18.699392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '119e78bd-a2a6-47e7-a670-9c7e6c50af78'} Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:28:18.700354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:18.701865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:18.703459 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c463691e-6278-464d-82dd-24ea47a567a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Returning 404 to user: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:28:18.703459 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c463691e-6278-464d-82dd-24ea47a567a0 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 404 len: 111 microversion: 2.20 time: 0.030373 Jun 23 17:28:18.703459 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 593/1206] 10.222.0.18 () {60 vars in 1279 bytes} [Thu Jun 23 17:28:18 2022] DELETE /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 17:28:18.708154 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-8a0b787c-6fd0-422f-aeb9-921309c71953 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:18.708877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-8a0b787c-6fd0-422f-aeb9-921309c71953 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 119e78bd-a2a6-47e7-a670-9c7e6c50af78] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:18.715248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8a0b787c-6fd0-422f-aeb9-921309c71953 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:18.715699 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8a0b787c-6fd0-422f-aeb9-921309c71953 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:18.716447 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8a0b787c-6fd0-422f-aeb9-921309c71953 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:18.716881 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8a0b787c-6fd0-422f-aeb9-921309c71953 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:18.733217 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-8a0b787c-6fd0-422f-aeb9-921309c71953 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] HTTP exception thrown: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-8a0b787c-6fd0-422f-aeb9-921309c71953 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Request method failure captured: Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 HTTP/1.1 Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitKDEhCPK9tkfoHLNMHQIRrqQPCKKYaJezXov2YfTbzWmyaYPrcKbmkKlwfJ7GySbnCTV3NhFoy6Iz93RK79PHDkYXIFn1ThqI4QnK6t9x1X2RwAe0RUS3Mc7a0UpX_zgAmDqWXfMD6__Bbgp3MOZ0I25bHPbKB-n3apP_ZgZkkJ9n18 Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: e2d73f7bfc184cacb49809a89563b585 Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:28:18.734894 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:28:18.736571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e2d73f7bfc184cacb49809a89563b585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2d73f7bfc184cacb49809a89563b585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e2d73f7bfc184cacb49809a89563b585", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2d73f7bfc184cacb49809a89563b585"}]}] Jun 23 17:28:18.736571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:18.736571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: e2d73f7bfc184cacb49809a89563b585 Jun 23 17:28:18.736571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:18.736571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-AttachVolumeShelveTestJSON-682111542-project Jun 23 17:28:18.736571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:28:18.736571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:28:18.736571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 4b43fe7da444445fbffb6158d332d99d Jun 23 17:28:18.736571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-AttachVolumeShelveTestJSON-682111542-project Jun 23 17:28:18.736571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:28:18.736571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:18.736571 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '119e78bd-a2a6-47e7-a670-9c7e6c50af78'} Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:28:18.738024 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. Jun 23 17:28:18.740477 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:28:18.742670 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-8a0b787c-6fd0-422f-aeb9-921309c71953 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Returning 404 to user: Instance 119e78bd-a2a6-47e7-a670-9c7e6c50af78 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:28:18.742670 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-8a0b787c-6fd0-422f-aeb9-921309c71953 tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78" status: 404 len: 111 microversion: 2.20 time: 0.032631 Jun 23 17:28:18.742670 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 614/1207] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:28:18 2022] GET /compute/v2.1/servers/119e78bd-a2a6-47e7-a670-9c7e6c50af78 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 17:28:19.892877 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cee236ec-0038-4d8d-863c-5efde864765f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:19.893389 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cee236ec-0038-4d8d-863c-5efde864765f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:19.900593 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cee236ec-0038-4d8d-863c-5efde864765f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:19.901033 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cee236ec-0038-4d8d-863c-5efde864765f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:19.901807 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cee236ec-0038-4d8d-863c-5efde864765f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:19.902246 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cee236ec-0038-4d8d-863c-5efde864765f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:19.916441 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-cee236ec-0038-4d8d-863c-5efde864765f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] HTTP exception thrown: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cee236ec-0038-4d8d-863c-5efde864765f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Request method failure captured: Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: DELETE /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb HTTP/1.1 Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitKDEhCPK9tkfoHLNMHQIRrqQPCKKYaJezXov2YfTbzWmyaYPrcKbmkKlwfJ7GySbnCTV3NhFoy6Iz93RK79PHDkYXIFn1ThqI4QnK6t9x1X2RwAe0RUS3Mc7a0UpX_zgAmDqWXfMD6__Bbgp3MOZ0I25bHPbKB-n3apP_ZgZkkJ9n18 Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: e2d73f7bfc184cacb49809a89563b585 Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:28:19.918000 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:28:19.919754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e2d73f7bfc184cacb49809a89563b585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2d73f7bfc184cacb49809a89563b585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e2d73f7bfc184cacb49809a89563b585", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2d73f7bfc184cacb49809a89563b585"}]}] Jun 23 17:28:19.919754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:19.919754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: e2d73f7bfc184cacb49809a89563b585 Jun 23 17:28:19.919754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:19.919754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeShelveTestJSON-682111542-project Jun 23 17:28:19.919754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:28:19.919754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:28:19.919754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: 4b43fe7da444445fbffb6158d332d99d Jun 23 17:28:19.919754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeShelveTestJSON-682111542-project Jun 23 17:28:19.919754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:28:19.919754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:28:19.919754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '65320df8-ae02-4a62-bde7-14088815afcb'} Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:28:19.920696 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:28:19.922295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:28:19.923948 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cee236ec-0038-4d8d-863c-5efde864765f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Returning 404 to user: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:28:19.923948 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cee236ec-0038-4d8d-863c-5efde864765f tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "DELETE /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 404 len: 111 microversion: 2.20 time: 0.030431 Jun 23 17:28:19.923948 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 594/1208] 10.222.0.18 () {60 vars in 1279 bytes} [Thu Jun 23 17:28:19 2022] DELETE /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 17:28:19.928144 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-288e0c1c-e62d-4c75-89ea-98da9127f16d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:19.928751 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-288e0c1c-e62d-4c75-89ea-98da9127f16d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] [instance: 65320df8-ae02-4a62-bde7-14088815afcb] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:19.935363 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-288e0c1c-e62d-4c75-89ea-98da9127f16d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:19.936151 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-288e0c1c-e62d-4c75-89ea-98da9127f16d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:19.936918 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-288e0c1c-e62d-4c75-89ea-98da9127f16d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:19.937337 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-288e0c1c-e62d-4c75-89ea-98da9127f16d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:19.951222 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-288e0c1c-e62d-4c75-89ea-98da9127f16d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] HTTP exception thrown: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-288e0c1c-e62d-4c75-89ea-98da9127f16d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Request method failure captured: Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb HTTP/1.1 Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitKDEhCPK9tkfoHLNMHQIRrqQPCKKYaJezXov2YfTbzWmyaYPrcKbmkKlwfJ7GySbnCTV3NhFoy6Iz93RK79PHDkYXIFn1ThqI4QnK6t9x1X2RwAe0RUS3Mc7a0UpX_zgAmDqWXfMD6__Bbgp3MOZ0I25bHPbKB-n3apP_ZgZkkJ9n18 Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: e2d73f7bfc184cacb49809a89563b585 Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:28:19.952667 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:28:19.954435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e2d73f7bfc184cacb49809a89563b585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2d73f7bfc184cacb49809a89563b585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e2d73f7bfc184cacb49809a89563b585", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2d73f7bfc184cacb49809a89563b585"}]}] Jun 23 17:28:19.954435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:19.954435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: e2d73f7bfc184cacb49809a89563b585 Jun 23 17:28:19.954435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-682111542 Jun 23 17:28:19.954435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-AttachVolumeShelveTestJSON-682111542-project Jun 23 17:28:19.954435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:28:19.954435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:28:19.954435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 4b43fe7da444445fbffb6158d332d99d Jun 23 17:28:19.954435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-AttachVolumeShelveTestJSON-682111542-project Jun 23 17:28:19.954435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:28:19.954435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:28:19.954435 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '65320df8-ae02-4a62-bde7-14088815afcb'} Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:28:19.955502 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. Jun 23 17:28:19.957102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:28:19.958577 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-288e0c1c-e62d-4c75-89ea-98da9127f16d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] Returning 404 to user: Instance 65320df8-ae02-4a62-bde7-14088815afcb could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:28:19.958577 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-288e0c1c-e62d-4c75-89ea-98da9127f16d tempest-AttachVolumeShelveTestJSON-682111542 tempest-AttachVolumeShelveTestJSON-682111542-project] 10.222.0.18 "GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb" status: 404 len: 111 microversion: 2.20 time: 0.030156 Jun 23 17:28:19.958577 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 615/1209] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 23 17:28:19 2022] GET /compute/v2.1/servers/65320df8-ae02-4a62-bde7-14088815afcb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 17:28:28.644101 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5ca852a1-40dc-4c29-ae85-7ad6637b7de8 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Action: 'create', calling method: .version_select at 0x7f342dbf1040>, body: {"keypair": {"name": "tempest-keypair-70078279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvccfyoWDFAeSExs1Z/MCs9k7LdDa5ROha8fwKvBo8hjZ4H+9vtr3/1ijyBWCAOaJo0Qu8d9kr7Js8bxEcHzKoc1M9yn5AWEg38Pdj9BM4wstY8xwYkQTSYzoWxHTMtpQ=="}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:28:28.658752 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-5ca852a1-40dc-4c29-ae85-7ad6637b7de8 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Getting quotas for project 1bba540f52204efcb203231d7d780810. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:28:28.663058 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-5ca852a1-40dc-4c29-ae85-7ad6637b7de8 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Getting quotas for user 2fd5f4bd4834436bace14bcca9768658 and project 1bba540f52204efcb203231d7d780810. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:28:28.696144 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5ca852a1-40dc-4c29-ae85-7ad6637b7de8 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.199821 Jun 23 17:28:28.696876 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 595/1210] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 23 17:28:28 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:28:30.031277 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-985659530", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aeace213-3fb6-4ee9-a403-3b20d69c9259"}], "security_groups": [{"name": "tempest-securitygroup--206069772"}], "key_name": "tempest-keypair-70078279", "user_data": "}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:28:30.040781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:30.042350 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:30.148730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.network.neutron [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] validate_networks() for [('aeace213-3fb6-4ee9-a403-3b20d69c9259', None, None, None, None, None)] {{(pid=117897) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:28:30.527741 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Flavor limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:28:30.528167 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Image limits 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:28:30.528638 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Flavor pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:28:30.529049 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Image pref 0:0:0 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:28:30.529595 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.virt.hardware [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:28:30.538770 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:30.539224 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:30.540046 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:30.540494 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:30.557714 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Getting quotas for project 1bba540f52204efcb203231d7d780810. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:28:30.562441 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Getting quotas for user 2fd5f4bd4834436bace14bcca9768658 and project 1bba540f52204efcb203231d7d780810. Resources: {'instances', 'ram', 'cores'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:28:30.574919 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Going to run 1 instances... {{(pid=117897) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:28:30.577451 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:28:30.629779 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-bb3e7e8b-394b-49f8-9e89-c3eadbedac45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.602461 Jun 23 17:28:30.633943 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 616/1211] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:28:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:28:30.638402 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=24 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:30.643584 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9d13f01a-4adc-4ef4-8ab4-0d3a9f9c96c3 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:30.644233 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9d13f01a-4adc-4ef4-8ab4-0d3a9f9c96c3 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:30.708855 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9d13f01a-4adc-4ef4-8ab4-0d3a9f9c96c3 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:30.715695 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9d13f01a-4adc-4ef4-8ab4-0d3a9f9c96c3 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1235 microversion: 2.1 time: 0.078709 Jun 23 17:28:30.722247 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 596/1212] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:28:30 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1235 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:28:31.734288 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-17dd92be-8ffa-4a05-bcb4-eeb930e1d757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:31.734909 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-17dd92be-8ffa-4a05-bcb4-eeb930e1d757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:31.743761 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-17dd92be-8ffa-4a05-bcb4-eeb930e1d757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:31.745378 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-17dd92be-8ffa-4a05-bcb4-eeb930e1d757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:31.746751 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-17dd92be-8ffa-4a05-bcb4-eeb930e1d757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:31.747387 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-17dd92be-8ffa-4a05-bcb4-eeb930e1d757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:31.822104 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-17dd92be-8ffa-4a05-bcb4-eeb930e1d757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:31.831566 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-17dd92be-8ffa-4a05-bcb4-eeb930e1d757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1305 microversion: 2.1 time: 0.101701 Jun 23 17:28:31.833042 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 617/1213] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:28:31 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:28:32.850095 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4403bb4c-a5d1-419e-9db5-73fdbae30a65 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:32.850760 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4403bb4c-a5d1-419e-9db5-73fdbae30a65 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:32.857404 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4403bb4c-a5d1-419e-9db5-73fdbae30a65 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:32.857880 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4403bb4c-a5d1-419e-9db5-73fdbae30a65 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:32.858655 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4403bb4c-a5d1-419e-9db5-73fdbae30a65 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:32.859087 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4403bb4c-a5d1-419e-9db5-73fdbae30a65 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:33.155198 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4403bb4c-a5d1-419e-9db5-73fdbae30a65 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:33.163524 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4403bb4c-a5d1-419e-9db5-73fdbae30a65 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1360 microversion: 2.1 time: 0.317680 Jun 23 17:28:33.164257 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 597/1214] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:28:32 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1360 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:28:33.348348 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-fd86d373-835f-4a29-95f7-17e5f7472d80 req-74e9fd15-4c91-48d9-8bd0-6b0e4595e0ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "118fd6aa-e870-4729-a2e4-9a44e0a347b6", "tag": "8abefecb-875d-43d2-8bc2-0b6245d9d087"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:28:33.358895 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-fd86d373-835f-4a29-95f7-17e5f7472d80 req-74e9fd15-4c91-48d9-8bd0-6b0e4595e0ba service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:33.359570 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-fd86d373-835f-4a29-95f7-17e5f7472d80 req-74e9fd15-4c91-48d9-8bd0-6b0e4595e0ba service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:33.385102 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-fd86d373-835f-4a29-95f7-17e5f7472d80 req-74e9fd15-4c91-48d9-8bd0-6b0e4595e0ba service nova] Creating event network-changed:8abefecb-875d-43d2-8bc2-0b6245d9d087 for instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 on hv-cinder-83538 Jun 23 17:28:33.391527 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-fd86d373-835f-4a29-95f7-17e5f7472d80 req-74e9fd15-4c91-48d9-8bd0-6b0e4595e0ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048178 Jun 23 17:28:33.392749 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 618/1215] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:28:34.186232 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5dc3c1cd-6459-44e1-b6f5-df2d8e9d0936 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:34.187623 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5dc3c1cd-6459-44e1-b6f5-df2d8e9d0936 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:34.196135 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5dc3c1cd-6459-44e1-b6f5-df2d8e9d0936 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:34.196576 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5dc3c1cd-6459-44e1-b6f5-df2d8e9d0936 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:34.197330 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5dc3c1cd-6459-44e1-b6f5-df2d8e9d0936 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:34.197761 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5dc3c1cd-6459-44e1-b6f5-df2d8e9d0936 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:34.327484 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5dc3c1cd-6459-44e1-b6f5-df2d8e9d0936 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:34.335590 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5dc3c1cd-6459-44e1-b6f5-df2d8e9d0936 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1360 microversion: 2.1 time: 0.156340 Jun 23 17:28:34.336161 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 598/1216] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:28:34 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:28:35.361367 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-14cabf59-e2a5-4ed1-a2fc-c9fa16c648a9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:35.362707 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-14cabf59-e2a5-4ed1-a2fc-c9fa16c648a9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:35.373378 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-14cabf59-e2a5-4ed1-a2fc-c9fa16c648a9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:35.373378 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-14cabf59-e2a5-4ed1-a2fc-c9fa16c648a9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:35.373378 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-14cabf59-e2a5-4ed1-a2fc-c9fa16c648a9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:35.373378 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-14cabf59-e2a5-4ed1-a2fc-c9fa16c648a9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:35.571308 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-14cabf59-e2a5-4ed1-a2fc-c9fa16c648a9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:35.579408 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-14cabf59-e2a5-4ed1-a2fc-c9fa16c648a9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1360 microversion: 2.1 time: 0.225283 Jun 23 17:28:35.579981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 619/1217] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:28:35 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1360 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:28:36.598466 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0126e99d-4b17-440e-94f2-f64a17c6aaac tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:36.599096 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0126e99d-4b17-440e-94f2-f64a17c6aaac tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:36.606490 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0126e99d-4b17-440e-94f2-f64a17c6aaac tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:36.607264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0126e99d-4b17-440e-94f2-f64a17c6aaac tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:36.609027 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0126e99d-4b17-440e-94f2-f64a17c6aaac tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:36.609462 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0126e99d-4b17-440e-94f2-f64a17c6aaac tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:36.759867 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0126e99d-4b17-440e-94f2-f64a17c6aaac tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:36.767489 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0126e99d-4b17-440e-94f2-f64a17c6aaac tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1360 microversion: 2.1 time: 0.173578 Jun 23 17:28:36.768048 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 599/1218] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:28:36 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1360 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:28:37.788620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6123b6e2-69fb-453d-9a7e-a075a2e029f9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:37.789722 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6123b6e2-69fb-453d-9a7e-a075a2e029f9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:37.800697 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6123b6e2-69fb-453d-9a7e-a075a2e029f9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:37.801558 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6123b6e2-69fb-453d-9a7e-a075a2e029f9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:37.802375 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6123b6e2-69fb-453d-9a7e-a075a2e029f9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:37.802800 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6123b6e2-69fb-453d-9a7e-a075a2e029f9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:37.943448 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6123b6e2-69fb-453d-9a7e-a075a2e029f9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:37.951001 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6123b6e2-69fb-453d-9a7e-a075a2e029f9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1360 microversion: 2.1 time: 0.168917 Jun 23 17:28:37.951576 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 620/1219] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:28:37 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1360 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:28:38.604282 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-9850a985-e814-4c14-b0ac-88f7e4527a7c req-9b9fb9ed-60bd-4a02-a3a7-9847777c36bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118fd6aa-e870-4729-a2e4-9a44e0a347b6", "name": "network-vif-plugged", "status": "completed", "tag": "8abefecb-875d-43d2-8bc2-0b6245d9d087"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:28:38.615314 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9850a985-e814-4c14-b0ac-88f7e4527a7c req-9b9fb9ed-60bd-4a02-a3a7-9847777c36bc service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:38.615883 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9850a985-e814-4c14-b0ac-88f7e4527a7c req-9b9fb9ed-60bd-4a02-a3a7-9847777c36bc service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:38.627497 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-9850a985-e814-4c14-b0ac-88f7e4527a7c req-9b9fb9ed-60bd-4a02-a3a7-9847777c36bc service nova] Creating event network-vif-plugged:8abefecb-875d-43d2-8bc2-0b6245d9d087 for instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 on hv-cinder-83538 Jun 23 17:28:38.633317 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-9850a985-e814-4c14-b0ac-88f7e4527a7c req-9b9fb9ed-60bd-4a02-a3a7-9847777c36bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032846 Jun 23 17:28:38.633951 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 600/1220] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:28:38.971295 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-57aae004-b9e5-429b-9f66-eecdceaf0cce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:38.972220 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-57aae004-b9e5-429b-9f66-eecdceaf0cce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:38.979398 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57aae004-b9e5-429b-9f66-eecdceaf0cce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:38.979843 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57aae004-b9e5-429b-9f66-eecdceaf0cce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:38.980603 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57aae004-b9e5-429b-9f66-eecdceaf0cce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:38.981032 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57aae004-b9e5-429b-9f66-eecdceaf0cce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:39.121231 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-57aae004-b9e5-429b-9f66-eecdceaf0cce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:39.131487 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-57aae004-b9e5-429b-9f66-eecdceaf0cce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1360 microversion: 2.1 time: 0.165898 Jun 23 17:28:39.132316 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 621/1221] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:28:38 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1360 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:28:40.158469 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fdefb4f6-e207-4c1a-94cf-53cba217aa37 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:40.159616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fdefb4f6-e207-4c1a-94cf-53cba217aa37 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:40.166913 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fdefb4f6-e207-4c1a-94cf-53cba217aa37 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:40.167376 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fdefb4f6-e207-4c1a-94cf-53cba217aa37 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:40.168189 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fdefb4f6-e207-4c1a-94cf-53cba217aa37 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:40.168613 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fdefb4f6-e207-4c1a-94cf-53cba217aa37 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:40.303514 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fdefb4f6-e207-4c1a-94cf-53cba217aa37 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:40.311655 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fdefb4f6-e207-4c1a-94cf-53cba217aa37 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1360 microversion: 2.1 time: 0.161238 Jun 23 17:28:40.312226 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 601/1222] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:28:40 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:28:41.332660 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4eaac4dc-16e2-4b62-b622-de48caf5d068 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:41.333686 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4eaac4dc-16e2-4b62-b622-de48caf5d068 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:41.336859 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=2 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:41.337953 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=6 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:41.344565 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4eaac4dc-16e2-4b62-b622-de48caf5d068 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:41.345009 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4eaac4dc-16e2-4b62-b622-de48caf5d068 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:41.345772 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4eaac4dc-16e2-4b62-b622-de48caf5d068 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:41.346251 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4eaac4dc-16e2-4b62-b622-de48caf5d068 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:41.484096 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4eaac4dc-16e2-4b62-b622-de48caf5d068 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:28:41.492092 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4eaac4dc-16e2-4b62-b622-de48caf5d068 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1546 microversion: 2.1 time: 0.166039 Jun 23 17:28:41.492688 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 622/1223] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:28:41 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:28:41.513879 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e82c027f-7ad2-4d02-bd30-aabe9e54bbde tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:28:41.514468 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e82c027f-7ad2-4d02-bd30-aabe9e54bbde tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:28:41.516443 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:41.522732 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e82c027f-7ad2-4d02-bd30-aabe9e54bbde tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:41.523177 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e82c027f-7ad2-4d02-bd30-aabe9e54bbde tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:41.523932 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e82c027f-7ad2-4d02-bd30-aabe9e54bbde tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:41.524361 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e82c027f-7ad2-4d02-bd30-aabe9e54bbde tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:41.873179 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e82c027f-7ad2-4d02-bd30-aabe9e54bbde tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.362862 Jun 23 17:28:41.873980 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 602/1224] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 23 17:28:41 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/os-interface => generated 284 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:28:42.892152 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-cae51e89-7ac7-441f-90f7-122048e5caa2 req-b02564a5-66f1-45ad-a6e6-676a84662cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "118fd6aa-e870-4729-a2e4-9a44e0a347b6", "tag": "8abefecb-875d-43d2-8bc2-0b6245d9d087"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:28:42.900613 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-cae51e89-7ac7-441f-90f7-122048e5caa2 req-b02564a5-66f1-45ad-a6e6-676a84662cdd service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:28:42.901372 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-cae51e89-7ac7-441f-90f7-122048e5caa2 req-b02564a5-66f1-45ad-a6e6-676a84662cdd service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:28:42.913375 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-cae51e89-7ac7-441f-90f7-122048e5caa2 req-b02564a5-66f1-45ad-a6e6-676a84662cdd service nova] Creating event network-changed:8abefecb-875d-43d2-8bc2-0b6245d9d087 for instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 on hv-cinder-83538 Jun 23 17:28:42.919002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-cae51e89-7ac7-441f-90f7-122048e5caa2 req-b02564a5-66f1-45ad-a6e6-676a84662cdd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090253 Jun 23 17:28:42.919579 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 623/1225] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:29:47.557304 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:29:47.558388 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=30 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:29:47.566353 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-819a09fe-48a8-4318-9e7a-7ed29b74743f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:29:47.567111 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-819a09fe-48a8-4318-9e7a-7ed29b74743f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:29:47.577613 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-819a09fe-48a8-4318-9e7a-7ed29b74743f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:29:47.578081 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-819a09fe-48a8-4318-9e7a-7ed29b74743f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:29:47.578832 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-819a09fe-48a8-4318-9e7a-7ed29b74743f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:29:47.579264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-819a09fe-48a8-4318-9e7a-7ed29b74743f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:29:47.602750 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-819a09fe-48a8-4318-9e7a-7ed29b74743f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/ips" status: 200 len: 146 microversion: 2.1 time: 0.048799 Jun 23 17:29:47.603310 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 603/1226] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 23 17:29:47 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/ips => generated 146 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:29:51.413754 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:29:51.414720 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=36 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:29:51.420980 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a4696436-21c7-4d2c-b354-5d2ac8f3fd27 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f26b8ff-bb3c-42c4-8d8b-3646bb853f94"}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:29:51.422171 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a4696436-21c7-4d2c-b354-5d2ac8f3fd27 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:29:51.430297 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a4696436-21c7-4d2c-b354-5d2ac8f3fd27 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:29:51.430745 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a4696436-21c7-4d2c-b354-5d2ac8f3fd27 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:29:51.431497 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a4696436-21c7-4d2c-b354-5d2ac8f3fd27 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:29:51.431916 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a4696436-21c7-4d2c-b354-5d2ac8f3fd27 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:29:51.710506 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a4696436-21c7-4d2c-b354-5d2ac8f3fd27 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "POST /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299611 Jun 23 17:29:51.711260 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 624/1227] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 23 17:29:51 2022] POST /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:29:59.260664 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-337890e2-404d-4c5d-a458-1e92f8f0df2a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:29:59.263321 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:29:59.263987 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=4 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:29:59.270494 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-337890e2-404d-4c5d-a458-1e92f8f0df2a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:29:59.270946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-337890e2-404d-4c5d-a458-1e92f8f0df2a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:29:59.330261 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-337890e2-404d-4c5d-a458-1e92f8f0df2a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Going to try to stop instance {{(pid=117896) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 17:29:59.377106 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-337890e2-404d-4c5d-a458-1e92f8f0df2a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "POST /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/action" status: 202 len: 0 microversion: 2.1 time: 0.120206 Jun 23 17:29:59.377719 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 604/1228] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 23 17:29:59 2022] POST /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:29:59.387089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e1353b5f-ca39-4779-9e6b-fe25eb595005 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:29:59.388333 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e1353b5f-ca39-4779-9e6b-fe25eb595005 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:29:59.396244 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e1353b5f-ca39-4779-9e6b-fe25eb595005 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:29:59.396578 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e1353b5f-ca39-4779-9e6b-fe25eb595005 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:29:59.397705 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e1353b5f-ca39-4779-9e6b-fe25eb595005 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:29:59.398248 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e1353b5f-ca39-4779-9e6b-fe25eb595005 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:29:59.534299 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e1353b5f-ca39-4779-9e6b-fe25eb595005 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:29:59.543235 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e1353b5f-ca39-4779-9e6b-fe25eb595005 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1721 microversion: 2.1 time: 0.160832 Jun 23 17:29:59.543878 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 625/1229] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:29:59 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 17:30:00.565264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f890a991-e923-4461-9860-25d8feb0b7d2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:30:00.566164 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f890a991-e923-4461-9860-25d8feb0b7d2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:30:00.574669 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f890a991-e923-4461-9860-25d8feb0b7d2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:00.575125 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f890a991-e923-4461-9860-25d8feb0b7d2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:00.575892 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f890a991-e923-4461-9860-25d8feb0b7d2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:00.576325 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f890a991-e923-4461-9860-25d8feb0b7d2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:00.726943 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f890a991-e923-4461-9860-25d8feb0b7d2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:30:00.735423 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f890a991-e923-4461-9860-25d8feb0b7d2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1721 microversion: 2.1 time: 0.176778 Jun 23 17:30:00.736011 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 605/1230] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:30:00 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:30:01.753157 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f6448c38-87e1-4bb7-bfcf-35ae001df70e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:30:01.753726 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f6448c38-87e1-4bb7-bfcf-35ae001df70e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:30:01.760950 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f6448c38-87e1-4bb7-bfcf-35ae001df70e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:01.761395 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f6448c38-87e1-4bb7-bfcf-35ae001df70e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:01.762259 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f6448c38-87e1-4bb7-bfcf-35ae001df70e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:01.762873 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f6448c38-87e1-4bb7-bfcf-35ae001df70e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:01.920277 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f6448c38-87e1-4bb7-bfcf-35ae001df70e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:30:01.932714 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f6448c38-87e1-4bb7-bfcf-35ae001df70e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1721 microversion: 2.1 time: 0.182913 Jun 23 17:30:01.932714 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 626/1231] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:30:01 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:30:02.958355 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b934656d-90cb-41aa-b981-162c73941879 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:30:02.958975 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b934656d-90cb-41aa-b981-162c73941879 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:30:02.967151 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b934656d-90cb-41aa-b981-162c73941879 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:02.967598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b934656d-90cb-41aa-b981-162c73941879 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:02.968359 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b934656d-90cb-41aa-b981-162c73941879 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:02.968794 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b934656d-90cb-41aa-b981-162c73941879 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:03.108152 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b934656d-90cb-41aa-b981-162c73941879 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:30:03.119879 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b934656d-90cb-41aa-b981-162c73941879 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1721 microversion: 2.1 time: 0.166043 Jun 23 17:30:03.120447 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 606/1232] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:30:02 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:30:04.140251 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9cf1824a-84bf-46d2-a776-7cd61bcc5378 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:30:04.140879 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9cf1824a-84bf-46d2-a776-7cd61bcc5378 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:30:04.151126 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9cf1824a-84bf-46d2-a776-7cd61bcc5378 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:04.151734 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9cf1824a-84bf-46d2-a776-7cd61bcc5378 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:04.152842 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9cf1824a-84bf-46d2-a776-7cd61bcc5378 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:04.153535 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9cf1824a-84bf-46d2-a776-7cd61bcc5378 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:04.288604 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9cf1824a-84bf-46d2-a776-7cd61bcc5378 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:30:04.297323 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9cf1824a-84bf-46d2-a776-7cd61bcc5378 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1721 microversion: 2.1 time: 0.163413 Jun 23 17:30:04.297922 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 627/1233] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:30:04 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:30:05.323818 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c7ed13b9-d0bd-44ff-947b-922146cb16d6 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:30:05.324811 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c7ed13b9-d0bd-44ff-947b-922146cb16d6 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:30:05.332412 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7ed13b9-d0bd-44ff-947b-922146cb16d6 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:05.332847 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7ed13b9-d0bd-44ff-947b-922146cb16d6 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:05.333598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7ed13b9-d0bd-44ff-947b-922146cb16d6 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:05.334074 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7ed13b9-d0bd-44ff-947b-922146cb16d6 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:05.466865 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c7ed13b9-d0bd-44ff-947b-922146cb16d6 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:30:05.474993 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c7ed13b9-d0bd-44ff-947b-922146cb16d6 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1721 microversion: 2.1 time: 0.157738 Jun 23 17:30:05.475532 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 607/1234] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:30:05 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:30:06.494801 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e7b71df9-989d-4c31-9264-2f8f3ef24a57 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:30:06.495805 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e7b71df9-989d-4c31-9264-2f8f3ef24a57 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:30:06.502977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e7b71df9-989d-4c31-9264-2f8f3ef24a57 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:06.503427 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e7b71df9-989d-4c31-9264-2f8f3ef24a57 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:06.504189 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e7b71df9-989d-4c31-9264-2f8f3ef24a57 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:06.504620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e7b71df9-989d-4c31-9264-2f8f3ef24a57 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:06.650366 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e7b71df9-989d-4c31-9264-2f8f3ef24a57 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:30:06.660589 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e7b71df9-989d-4c31-9264-2f8f3ef24a57 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1721 microversion: 2.1 time: 0.171843 Jun 23 17:30:06.661159 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 628/1235] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:30:06 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:30:07.682490 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-406702ab-f3ba-42cc-921d-6e5e79db1a7e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:30:07.683505 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-406702ab-f3ba-42cc-921d-6e5e79db1a7e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:30:07.696484 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-406702ab-f3ba-42cc-921d-6e5e79db1a7e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:07.697256 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-406702ab-f3ba-42cc-921d-6e5e79db1a7e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:07.698763 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-406702ab-f3ba-42cc-921d-6e5e79db1a7e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:07.699516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-406702ab-f3ba-42cc-921d-6e5e79db1a7e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:07.841836 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-406702ab-f3ba-42cc-921d-6e5e79db1a7e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:30:07.850988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-406702ab-f3ba-42cc-921d-6e5e79db1a7e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1721 microversion: 2.1 time: 0.175282 Jun 23 17:30:07.851566 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 608/1236] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:30:07 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:30:08.868958 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-56cc6caf-5b25-4da2-8cce-3742a822937c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:30:08.869776 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-56cc6caf-5b25-4da2-8cce-3742a822937c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:30:08.879280 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-56cc6caf-5b25-4da2-8cce-3742a822937c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:08.879880 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-56cc6caf-5b25-4da2-8cce-3742a822937c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:08.881022 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-56cc6caf-5b25-4da2-8cce-3742a822937c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:08.881730 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-56cc6caf-5b25-4da2-8cce-3742a822937c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:09.018653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-56cc6caf-5b25-4da2-8cce-3742a822937c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:30:09.027170 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-56cc6caf-5b25-4da2-8cce-3742a822937c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1721 microversion: 2.1 time: 0.162157 Jun 23 17:30:09.027759 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 629/1237] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:30:08 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:30:10.046957 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8cbb02cd-ecd7-49cc-8e60-9f4bb4e5a36c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:30:10.047599 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8cbb02cd-ecd7-49cc-8e60-9f4bb4e5a36c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:30:10.055994 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8cbb02cd-ecd7-49cc-8e60-9f4bb4e5a36c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:10.056445 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8cbb02cd-ecd7-49cc-8e60-9f4bb4e5a36c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:10.057283 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8cbb02cd-ecd7-49cc-8e60-9f4bb4e5a36c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:10.057721 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8cbb02cd-ecd7-49cc-8e60-9f4bb4e5a36c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:10.192035 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8cbb02cd-ecd7-49cc-8e60-9f4bb4e5a36c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:30:10.200668 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8cbb02cd-ecd7-49cc-8e60-9f4bb4e5a36c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1698 microversion: 2.1 time: 0.160019 Jun 23 17:30:10.201256 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 609/1238] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:30:10 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:30:10.219267 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-098aacac-fa24-4dca-9b1a-1af21b95ce64 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:30:10.226549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-098aacac-fa24-4dca-9b1a-1af21b95ce64 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:10.227000 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-098aacac-fa24-4dca-9b1a-1af21b95ce64 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:10.287354 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-098aacac-fa24-4dca-9b1a-1af21b95ce64 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Going to try to start instance {{(pid=117897) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 17:30:10.333543 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-098aacac-fa24-4dca-9b1a-1af21b95ce64 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "POST /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/action" status: 202 len: 0 microversion: 2.1 time: 0.119838 Jun 23 17:30:10.334104 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 630/1239] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 23 17:30:10 2022] POST /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:30:10.344129 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0eeca9e8-ba29-4914-8726-b7e61a254813 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:30:10.344740 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0eeca9e8-ba29-4914-8726-b7e61a254813 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:30:10.351178 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0eeca9e8-ba29-4914-8726-b7e61a254813 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:10.351653 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0eeca9e8-ba29-4914-8726-b7e61a254813 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:10.352428 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0eeca9e8-ba29-4914-8726-b7e61a254813 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:10.352857 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0eeca9e8-ba29-4914-8726-b7e61a254813 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:10.491445 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0eeca9e8-ba29-4914-8726-b7e61a254813 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:30:10.499901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0eeca9e8-ba29-4914-8726-b7e61a254813 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1707 microversion: 2.1 time: 0.159980 Jun 23 17:30:10.500716 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 610/1240] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:30:10 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1707 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:30:11.523073 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-fbc4933c-a003-4295-b33e-2f42ebeeb4eb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:30:11.524269 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-fbc4933c-a003-4295-b33e-2f42ebeeb4eb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:30:11.533383 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fbc4933c-a003-4295-b33e-2f42ebeeb4eb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:11.533821 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fbc4933c-a003-4295-b33e-2f42ebeeb4eb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:11.534617 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fbc4933c-a003-4295-b33e-2f42ebeeb4eb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:11.535052 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-fbc4933c-a003-4295-b33e-2f42ebeeb4eb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:11.675723 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-fbc4933c-a003-4295-b33e-2f42ebeeb4eb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:30:11.693311 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-fbc4933c-a003-4295-b33e-2f42ebeeb4eb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1707 microversion: 2.1 time: 0.178138 Jun 23 17:30:11.693923 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 631/1241] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:30:11 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1707 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:30:12.711474 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-266f5609-ef5a-4527-9580-bc401cbf9f69 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:30:12.712084 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-266f5609-ef5a-4527-9580-bc401cbf9f69 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:30:12.718907 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-266f5609-ef5a-4527-9580-bc401cbf9f69 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:12.719354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-266f5609-ef5a-4527-9580-bc401cbf9f69 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:12.720114 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-266f5609-ef5a-4527-9580-bc401cbf9f69 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:30:12.720548 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-266f5609-ef5a-4527-9580-bc401cbf9f69 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:30:12.852029 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-266f5609-ef5a-4527-9580-bc401cbf9f69 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:30:12.860246 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-266f5609-ef5a-4527-9580-bc401cbf9f69 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1711 microversion: 2.1 time: 0.152832 Jun 23 17:30:12.860817 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 611/1242] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:30:12 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1711 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:15.990497 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=16 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:31:15.991271 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:31:15.995377 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-61d27098-0b55-46dd-b485-e61b25bc8fe8 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:15.995864 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-61d27098-0b55-46dd-b485-e61b25bc8fe8 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:16.003015 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-61d27098-0b55-46dd-b485-e61b25bc8fe8 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:16.003402 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-61d27098-0b55-46dd-b485-e61b25bc8fe8 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:16.004163 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-61d27098-0b55-46dd-b485-e61b25bc8fe8 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:16.004594 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-61d27098-0b55-46dd-b485-e61b25bc8fe8 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:16.085444 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-61d27098-0b55-46dd-b485-e61b25bc8fe8 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lazy-loading 'services' on Instance uuid 118fd6aa-e870-4729-a2e4-9a44e0a347b6 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:31:16.162848 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-61d27098-0b55-46dd-b485-e61b25bc8fe8 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "DELETE /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/os-volume_attachments/8f26b8ff-bb3c-42c4-8d8b-3646bb853f94" status: 202 len: 0 microversion: 2.1 time: 0.173965 Jun 23 17:31:16.163725 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 632/1243] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 23 17:31:15 2022] DELETE /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/os-volume_attachments/8f26b8ff-bb3c-42c4-8d8b-3646bb853f94 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:31:18.335616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=16 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:31:18.336380 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:31:18.340874 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f490a537-4424-435b-a17a-99d253c6fff1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:31:18.348180 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f490a537-4424-435b-a17a-99d253c6fff1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:18.348630 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f490a537-4424-435b-a17a-99d253c6fff1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:18.373947 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f490a537-4424-435b-a17a-99d253c6fff1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Going to try to stop instance {{(pid=117896) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 17:31:18.421433 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f490a537-4424-435b-a17a-99d253c6fff1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "POST /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/action" status: 202 len: 0 microversion: 2.1 time: 0.087470 Jun 23 17:31:18.422084 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 612/1244] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 23 17:31:18 2022] POST /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:31:18.431653 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f520cc74-2ff6-49ed-b70a-8cbb1e716594 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:18.432759 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f520cc74-2ff6-49ed-b70a-8cbb1e716594 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:18.439893 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f520cc74-2ff6-49ed-b70a-8cbb1e716594 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:18.440337 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f520cc74-2ff6-49ed-b70a-8cbb1e716594 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:18.441188 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f520cc74-2ff6-49ed-b70a-8cbb1e716594 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:18.441978 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f520cc74-2ff6-49ed-b70a-8cbb1e716594 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:18.585054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f520cc74-2ff6-49ed-b70a-8cbb1e716594 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:18.597410 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f520cc74-2ff6-49ed-b70a-8cbb1e716594 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.170310 Jun 23 17:31:18.598054 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 633/1245] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:18 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:19.620156 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e5c96254-4db9-4b70-b5f2-e9ee9040a4c1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:19.620817 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e5c96254-4db9-4b70-b5f2-e9ee9040a4c1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:19.627675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e5c96254-4db9-4b70-b5f2-e9ee9040a4c1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:19.628124 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e5c96254-4db9-4b70-b5f2-e9ee9040a4c1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:19.628891 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e5c96254-4db9-4b70-b5f2-e9ee9040a4c1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:19.629336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e5c96254-4db9-4b70-b5f2-e9ee9040a4c1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:19.767553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e5c96254-4db9-4b70-b5f2-e9ee9040a4c1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:19.775257 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e5c96254-4db9-4b70-b5f2-e9ee9040a4c1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.163393 Jun 23 17:31:19.776084 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 613/1246] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:19 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:20.796989 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a87f16be-821b-480c-a670-97755479f2c0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:20.798009 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a87f16be-821b-480c-a670-97755479f2c0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:20.809308 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a87f16be-821b-480c-a670-97755479f2c0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:20.810075 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a87f16be-821b-480c-a670-97755479f2c0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:20.811431 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a87f16be-821b-480c-a670-97755479f2c0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:20.812524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a87f16be-821b-480c-a670-97755479f2c0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:20.951586 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-a87f16be-821b-480c-a670-97755479f2c0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:20.959668 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a87f16be-821b-480c-a670-97755479f2c0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.169680 Jun 23 17:31:20.960228 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 634/1247] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:20 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:21.977974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-267c95e6-7567-4274-a2e9-47101c724cd7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:21.978625 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-267c95e6-7567-4274-a2e9-47101c724cd7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:21.985458 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-267c95e6-7567-4274-a2e9-47101c724cd7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:21.985904 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-267c95e6-7567-4274-a2e9-47101c724cd7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:21.986701 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-267c95e6-7567-4274-a2e9-47101c724cd7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:21.987129 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-267c95e6-7567-4274-a2e9-47101c724cd7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:22.198662 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-267c95e6-7567-4274-a2e9-47101c724cd7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:22.206656 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-267c95e6-7567-4274-a2e9-47101c724cd7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.232749 Jun 23 17:31:22.207233 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 614/1248] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:21 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:23.228063 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-bdea9dfe-4dc6-4c3d-aaee-691b056c3d39 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:23.229047 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-bdea9dfe-4dc6-4c3d-aaee-691b056c3d39 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:23.240002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bdea9dfe-4dc6-4c3d-aaee-691b056c3d39 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:23.240744 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bdea9dfe-4dc6-4c3d-aaee-691b056c3d39 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:23.242037 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bdea9dfe-4dc6-4c3d-aaee-691b056c3d39 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:23.242750 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-bdea9dfe-4dc6-4c3d-aaee-691b056c3d39 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:23.386868 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-bdea9dfe-4dc6-4c3d-aaee-691b056c3d39 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:23.395016 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-bdea9dfe-4dc6-4c3d-aaee-691b056c3d39 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.173502 Jun 23 17:31:23.395546 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 635/1249] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:23 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:24.417926 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a413193b-1274-4bcf-abec-c9e789ff0c4a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:24.418660 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a413193b-1274-4bcf-abec-c9e789ff0c4a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:24.427152 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a413193b-1274-4bcf-abec-c9e789ff0c4a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:24.427718 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a413193b-1274-4bcf-abec-c9e789ff0c4a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:24.428642 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a413193b-1274-4bcf-abec-c9e789ff0c4a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:24.429181 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a413193b-1274-4bcf-abec-c9e789ff0c4a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:24.559337 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a413193b-1274-4bcf-abec-c9e789ff0c4a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:24.567740 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a413193b-1274-4bcf-abec-c9e789ff0c4a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.156008 Jun 23 17:31:24.568310 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 615/1250] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:24 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:25.591509 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4131fe95-0b93-461d-9a31-b3bca85c58df tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:25.592465 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4131fe95-0b93-461d-9a31-b3bca85c58df tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:25.603519 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4131fe95-0b93-461d-9a31-b3bca85c58df tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:25.604769 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4131fe95-0b93-461d-9a31-b3bca85c58df tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:25.606092 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4131fe95-0b93-461d-9a31-b3bca85c58df tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:25.606816 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4131fe95-0b93-461d-9a31-b3bca85c58df tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:25.753209 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-4131fe95-0b93-461d-9a31-b3bca85c58df tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:25.761965 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4131fe95-0b93-461d-9a31-b3bca85c58df tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.177708 Jun 23 17:31:25.762513 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 636/1251] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:25 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:26.779700 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a14252a1-65ae-40ba-b052-96145ce86757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:26.780320 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a14252a1-65ae-40ba-b052-96145ce86757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:26.789420 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a14252a1-65ae-40ba-b052-96145ce86757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:26.789943 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a14252a1-65ae-40ba-b052-96145ce86757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:26.790992 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a14252a1-65ae-40ba-b052-96145ce86757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:26.791784 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a14252a1-65ae-40ba-b052-96145ce86757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:26.930150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a14252a1-65ae-40ba-b052-96145ce86757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:26.938149 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a14252a1-65ae-40ba-b052-96145ce86757 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.162444 Jun 23 17:31:26.938722 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 616/1252] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:26 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:27.959711 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-05f4e890-c7b9-4aa4-aeea-c42be02c7eca tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:27.960647 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-05f4e890-c7b9-4aa4-aeea-c42be02c7eca tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:27.969478 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-05f4e890-c7b9-4aa4-aeea-c42be02c7eca tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:27.969949 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-05f4e890-c7b9-4aa4-aeea-c42be02c7eca tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:27.970700 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-05f4e890-c7b9-4aa4-aeea-c42be02c7eca tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:27.971127 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-05f4e890-c7b9-4aa4-aeea-c42be02c7eca tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:28.114886 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-05f4e890-c7b9-4aa4-aeea-c42be02c7eca tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:28.122899 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-05f4e890-c7b9-4aa4-aeea-c42be02c7eca tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.169764 Jun 23 17:31:28.123463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 637/1253] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:27 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:29.144285 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-04a6d038-22f8-4f8c-b2ce-31338b8a14e7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:29.145231 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-04a6d038-22f8-4f8c-b2ce-31338b8a14e7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:29.154766 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04a6d038-22f8-4f8c-b2ce-31338b8a14e7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:29.155205 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04a6d038-22f8-4f8c-b2ce-31338b8a14e7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:29.155957 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04a6d038-22f8-4f8c-b2ce-31338b8a14e7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:29.156387 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04a6d038-22f8-4f8c-b2ce-31338b8a14e7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:29.284846 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-04a6d038-22f8-4f8c-b2ce-31338b8a14e7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:29.292871 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-04a6d038-22f8-4f8c-b2ce-31338b8a14e7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.155121 Jun 23 17:31:29.293462 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 617/1254] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:29 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:30.319086 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9103bf38-8586-4072-a08a-8d909b83393b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:30.320042 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9103bf38-8586-4072-a08a-8d909b83393b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:30.328165 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9103bf38-8586-4072-a08a-8d909b83393b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:30.328604 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9103bf38-8586-4072-a08a-8d909b83393b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:30.329347 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9103bf38-8586-4072-a08a-8d909b83393b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:30.329770 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9103bf38-8586-4072-a08a-8d909b83393b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:30.470733 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-9103bf38-8586-4072-a08a-8d909b83393b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:30.478533 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9103bf38-8586-4072-a08a-8d909b83393b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.165164 Jun 23 17:31:30.479099 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 638/1255] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:30 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:31.499504 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-572e7179-cd9e-41fd-a0f4-25955380ad71 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:31.500255 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-572e7179-cd9e-41fd-a0f4-25955380ad71 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:31.508264 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-572e7179-cd9e-41fd-a0f4-25955380ad71 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:31.508797 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-572e7179-cd9e-41fd-a0f4-25955380ad71 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:31.509691 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-572e7179-cd9e-41fd-a0f4-25955380ad71 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:31.510254 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-572e7179-cd9e-41fd-a0f4-25955380ad71 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:31.648279 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-572e7179-cd9e-41fd-a0f4-25955380ad71 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:31.656085 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-572e7179-cd9e-41fd-a0f4-25955380ad71 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.162600 Jun 23 17:31:31.656685 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 618/1256] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:31 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:32.678314 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-12dcec5a-b8a3-4d38-a510-5e5ee04dcf3c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:32.679240 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-12dcec5a-b8a3-4d38-a510-5e5ee04dcf3c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:32.691810 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12dcec5a-b8a3-4d38-a510-5e5ee04dcf3c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:32.692841 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12dcec5a-b8a3-4d38-a510-5e5ee04dcf3c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:32.694521 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12dcec5a-b8a3-4d38-a510-5e5ee04dcf3c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:32.695476 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-12dcec5a-b8a3-4d38-a510-5e5ee04dcf3c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:32.835474 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-12dcec5a-b8a3-4d38-a510-5e5ee04dcf3c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:32.845547 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-12dcec5a-b8a3-4d38-a510-5e5ee04dcf3c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.174796 Jun 23 17:31:32.846149 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 639/1257] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:32 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:33.867250 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7f64c0be-03b2-401d-b944-ad501875cc62 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:33.868078 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7f64c0be-03b2-401d-b944-ad501875cc62 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:33.879561 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7f64c0be-03b2-401d-b944-ad501875cc62 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:33.880130 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7f64c0be-03b2-401d-b944-ad501875cc62 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:33.881230 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7f64c0be-03b2-401d-b944-ad501875cc62 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:33.881735 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7f64c0be-03b2-401d-b944-ad501875cc62 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:34.039310 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7f64c0be-03b2-401d-b944-ad501875cc62 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:34.047048 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7f64c0be-03b2-401d-b944-ad501875cc62 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.186450 Jun 23 17:31:34.047646 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 619/1258] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:33 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:35.065496 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-57cfedb0-5320-4ccd-85b2-c7365dc7d648 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:35.066159 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-57cfedb0-5320-4ccd-85b2-c7365dc7d648 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:35.073208 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57cfedb0-5320-4ccd-85b2-c7365dc7d648 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:35.073651 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57cfedb0-5320-4ccd-85b2-c7365dc7d648 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:35.074446 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57cfedb0-5320-4ccd-85b2-c7365dc7d648 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:35.074875 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57cfedb0-5320-4ccd-85b2-c7365dc7d648 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:35.212676 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-57cfedb0-5320-4ccd-85b2-c7365dc7d648 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:35.221073 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-57cfedb0-5320-4ccd-85b2-c7365dc7d648 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.160086 Jun 23 17:31:35.221668 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 640/1259] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:35 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:36.243020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4856014f-2fe0-40d3-b722-41557cdd09e9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:36.243915 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4856014f-2fe0-40d3-b722-41557cdd09e9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:36.255652 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4856014f-2fe0-40d3-b722-41557cdd09e9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:36.256392 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4856014f-2fe0-40d3-b722-41557cdd09e9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:36.257281 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4856014f-2fe0-40d3-b722-41557cdd09e9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:36.257743 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4856014f-2fe0-40d3-b722-41557cdd09e9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:36.394972 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4856014f-2fe0-40d3-b722-41557cdd09e9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:36.405017 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4856014f-2fe0-40d3-b722-41557cdd09e9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.168817 Jun 23 17:31:36.405553 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 620/1260] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:36 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:37.426488 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-7fd6ef00-27f4-4c3b-8a6c-5d67db53e536 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:37.427494 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-7fd6ef00-27f4-4c3b-8a6c-5d67db53e536 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:37.438800 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7fd6ef00-27f4-4c3b-8a6c-5d67db53e536 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:37.439245 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7fd6ef00-27f4-4c3b-8a6c-5d67db53e536 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:37.439994 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7fd6ef00-27f4-4c3b-8a6c-5d67db53e536 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:37.440420 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-7fd6ef00-27f4-4c3b-8a6c-5d67db53e536 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:37.573563 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-7fd6ef00-27f4-4c3b-8a6c-5d67db53e536 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:37.581358 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-7fd6ef00-27f4-4c3b-8a6c-5d67db53e536 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.161436 Jun 23 17:31:37.581951 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 641/1261] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:37 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:38.603073 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9e8b54ec-7545-4cc1-9fed-8ca449add8d9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:38.604066 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9e8b54ec-7545-4cc1-9fed-8ca449add8d9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:38.613397 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e8b54ec-7545-4cc1-9fed-8ca449add8d9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:38.613844 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e8b54ec-7545-4cc1-9fed-8ca449add8d9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:38.614616 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e8b54ec-7545-4cc1-9fed-8ca449add8d9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:38.615047 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e8b54ec-7545-4cc1-9fed-8ca449add8d9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:38.754152 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9e8b54ec-7545-4cc1-9fed-8ca449add8d9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:38.766126 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9e8b54ec-7545-4cc1-9fed-8ca449add8d9 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1675 microversion: 2.1 time: 0.169432 Jun 23 17:31:38.767022 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 621/1262] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:38 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:39.788506 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-d0a2f4b0-d918-4ef3-a034-99d873ebcbfd tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:39.789471 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-d0a2f4b0-d918-4ef3-a034-99d873ebcbfd tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:39.800344 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d0a2f4b0-d918-4ef3-a034-99d873ebcbfd tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:39.801088 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d0a2f4b0-d918-4ef3-a034-99d873ebcbfd tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:39.802392 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d0a2f4b0-d918-4ef3-a034-99d873ebcbfd tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:39.803109 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-d0a2f4b0-d918-4ef3-a034-99d873ebcbfd tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:39.959126 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-d0a2f4b0-d918-4ef3-a034-99d873ebcbfd tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:39.966757 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-d0a2f4b0-d918-4ef3-a034-99d873ebcbfd tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1652 microversion: 2.1 time: 0.184848 Jun 23 17:31:39.967295 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 642/1263] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:39 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1652 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:39.983683 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b0a1d24b-6a6b-4b2c-8777-3630a6e8d736 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:31:39.990776 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0a1d24b-6a6b-4b2c-8777-3630a6e8d736 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:39.991215 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0a1d24b-6a6b-4b2c-8777-3630a6e8d736 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:40.013458 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b0a1d24b-6a6b-4b2c-8777-3630a6e8d736 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Going to try to start instance {{(pid=117896) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 17:31:40.065965 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b0a1d24b-6a6b-4b2c-8777-3630a6e8d736 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "POST /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/action" status: 202 len: 0 microversion: 2.1 time: 0.085783 Jun 23 17:31:40.066733 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 622/1264] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 23 17:31:39 2022] POST /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 17:31:40.075572 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-0859910e-3dc7-467b-858c-e77afdfa3c13 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:40.076176 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-0859910e-3dc7-467b-858c-e77afdfa3c13 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:40.082693 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0859910e-3dc7-467b-858c-e77afdfa3c13 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:40.083168 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0859910e-3dc7-467b-858c-e77afdfa3c13 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:40.083934 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0859910e-3dc7-467b-858c-e77afdfa3c13 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:40.084364 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-0859910e-3dc7-467b-858c-e77afdfa3c13 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:40.217513 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-0859910e-3dc7-467b-858c-e77afdfa3c13 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:40.226206 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-0859910e-3dc7-467b-858c-e77afdfa3c13 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1661 microversion: 2.1 time: 0.155194 Jun 23 17:31:40.226792 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 643/1265] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:40 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1661 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:41.249546 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-86c69123-6217-4ac9-bef2-5c36f0cb4fa7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:41.250739 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-86c69123-6217-4ac9-bef2-5c36f0cb4fa7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:41.258267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-86c69123-6217-4ac9-bef2-5c36f0cb4fa7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:41.258723 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-86c69123-6217-4ac9-bef2-5c36f0cb4fa7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:41.259494 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-86c69123-6217-4ac9-bef2-5c36f0cb4fa7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:41.259925 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-86c69123-6217-4ac9-bef2-5c36f0cb4fa7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:41.393351 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-86c69123-6217-4ac9-bef2-5c36f0cb4fa7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:41.401056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-86c69123-6217-4ac9-bef2-5c36f0cb4fa7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1661 microversion: 2.1 time: 0.159454 Jun 23 17:31:41.401597 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 623/1266] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:41 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1661 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:31:42.426278 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-2b5cdd79-7b1c-4568-9853-c718821d5266 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:31:42.426924 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-2b5cdd79-7b1c-4568-9853-c718821d5266 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:31:42.433524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2b5cdd79-7b1c-4568-9853-c718821d5266 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:42.434003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2b5cdd79-7b1c-4568-9853-c718821d5266 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:42.434767 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2b5cdd79-7b1c-4568-9853-c718821d5266 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:31:42.435180 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-2b5cdd79-7b1c-4568-9853-c718821d5266 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:31:42.572319 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-2b5cdd79-7b1c-4568-9853-c718821d5266 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:31:42.584929 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-2b5cdd79-7b1c-4568-9853-c718821d5266 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1665 microversion: 2.1 time: 0.163009 Jun 23 17:31:42.585688 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 644/1267] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:31:42 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:08.723974 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:32:08.724530 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Thu Jun 23 17:32:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:32:31.150358 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f8223252-6cd3-44ea-8f7b-c3dee3621ae1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:31.151459 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f8223252-6cd3-44ea-8f7b-c3dee3621ae1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:31.154354 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=24 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:32:31.155011 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:32:31.163792 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8223252-6cd3-44ea-8f7b-c3dee3621ae1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:31.164375 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8223252-6cd3-44ea-8f7b-c3dee3621ae1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:31.165419 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8223252-6cd3-44ea-8f7b-c3dee3621ae1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:31.166104 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8223252-6cd3-44ea-8f7b-c3dee3621ae1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:31.198443 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f8223252-6cd3-44ea-8f7b-c3dee3621ae1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054839 Jun 23 17:32:31.199136 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 624/1268] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:32:31 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 17:32:31.258873 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5eea64ff-c782-422f-bc93-91f2eeb9e3be tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:31.259412 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5eea64ff-c782-422f-bc93-91f2eeb9e3be tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:31.261772 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=26 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:32:31.262466 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:32:31.268157 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5eea64ff-c782-422f-bc93-91f2eeb9e3be tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:31.268596 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5eea64ff-c782-422f-bc93-91f2eeb9e3be tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:31.269354 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5eea64ff-c782-422f-bc93-91f2eeb9e3be tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:31.269787 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5eea64ff-c782-422f-bc93-91f2eeb9e3be tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:31.295922 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5eea64ff-c782-422f-bc93-91f2eeb9e3be tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Going to try to terminate instance {{(pid=117897) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:32:31.387769 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5eea64ff-c782-422f-bc93-91f2eeb9e3be tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "DELETE /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 204 len: 0 microversion: 2.1 time: 0.132344 Jun 23 17:32:31.388533 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 645/1269] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:32:31 2022] DELETE /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:32:31.397545 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f6e80172-764d-474a-8b2a-6371bcd2a7ce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:31.398303 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f6e80172-764d-474a-8b2a-6371bcd2a7ce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:31.404636 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6e80172-764d-474a-8b2a-6371bcd2a7ce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:31.405076 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6e80172-764d-474a-8b2a-6371bcd2a7ce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:31.405821 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6e80172-764d-474a-8b2a-6371bcd2a7ce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:31.406296 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6e80172-764d-474a-8b2a-6371bcd2a7ce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:31.544693 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f6e80172-764d-474a-8b2a-6371bcd2a7ce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:31.556511 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f6e80172-764d-474a-8b2a-6371bcd2a7ce tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1671 microversion: 2.1 time: 0.162765 Jun 23 17:32:31.557299 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 625/1270] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:31 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:32.580210 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-1789974d-269c-4a09-9bae-e37e841ecc59 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:32.581341 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-1789974d-269c-4a09-9bae-e37e841ecc59 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:32.592232 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1789974d-269c-4a09-9bae-e37e841ecc59 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:32.592970 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1789974d-269c-4a09-9bae-e37e841ecc59 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:32.594215 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1789974d-269c-4a09-9bae-e37e841ecc59 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:32.594931 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-1789974d-269c-4a09-9bae-e37e841ecc59 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:32.749057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-1789974d-269c-4a09-9bae-e37e841ecc59 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:32.756738 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-1789974d-269c-4a09-9bae-e37e841ecc59 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1671 microversion: 2.1 time: 0.184174 Jun 23 17:32:32.757296 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 646/1271] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:32 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1671 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:33.778208 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-69bec7a9-2a92-4697-b6a5-a196f2b0e84b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:33.778774 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-69bec7a9-2a92-4697-b6a5-a196f2b0e84b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:33.785939 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-69bec7a9-2a92-4697-b6a5-a196f2b0e84b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:33.786381 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-69bec7a9-2a92-4697-b6a5-a196f2b0e84b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:33.787129 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-69bec7a9-2a92-4697-b6a5-a196f2b0e84b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:33.787557 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-69bec7a9-2a92-4697-b6a5-a196f2b0e84b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:34.005577 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-69bec7a9-2a92-4697-b6a5-a196f2b0e84b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:34.013891 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-69bec7a9-2a92-4697-b6a5-a196f2b0e84b tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1671 microversion: 2.1 time: 0.241884 Jun 23 17:32:34.014473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 626/1272] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:33 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1671 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:34.758080 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-16eaa0ba-0698-4d5f-83e4-c8d6f51e5793 req-34d7e96e-0fb6-4aec-bdda-df00b4c64d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118fd6aa-e870-4729-a2e4-9a44e0a347b6", "name": "network-vif-deleted", "tag": "8abefecb-875d-43d2-8bc2-0b6245d9d087"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:32:34.767629 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-16eaa0ba-0698-4d5f-83e4-c8d6f51e5793 req-34d7e96e-0fb6-4aec-bdda-df00b4c64d50 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:34.768089 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-16eaa0ba-0698-4d5f-83e4-c8d6f51e5793 req-34d7e96e-0fb6-4aec-bdda-df00b4c64d50 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:34.781657 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-16eaa0ba-0698-4d5f-83e4-c8d6f51e5793 req-34d7e96e-0fb6-4aec-bdda-df00b4c64d50 service nova] Creating event network-vif-deleted:8abefecb-875d-43d2-8bc2-0b6245d9d087 for instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 on hv-cinder-83538 Jun 23 17:32:34.787235 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-16eaa0ba-0698-4d5f-83e4-c8d6f51e5793 req-34d7e96e-0fb6-4aec-bdda-df00b4c64d50 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032920 Jun 23 17:32:34.791223 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 647/1273] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:32:35.032421 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-821932ca-73eb-4ebc-91a7-4c715c079569 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:35.033041 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-821932ca-73eb-4ebc-91a7-4c715c079569 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:35.039861 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-821932ca-73eb-4ebc-91a7-4c715c079569 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:35.040295 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-821932ca-73eb-4ebc-91a7-4c715c079569 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:35.041063 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-821932ca-73eb-4ebc-91a7-4c715c079569 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:35.041488 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-821932ca-73eb-4ebc-91a7-4c715c079569 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:35.072962 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-821932ca-73eb-4ebc-91a7-4c715c079569 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:35.073403 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-821932ca-73eb-4ebc-91a7-4c715c079569 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:35.073883 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-821932ca-73eb-4ebc-91a7-4c715c079569 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lazy-loading 'fault' on Instance uuid 118fd6aa-e870-4729-a2e4-9a44e0a347b6 {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:32:35.114660 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-821932ca-73eb-4ebc-91a7-4c715c079569 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:35.122405 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-821932ca-73eb-4ebc-91a7-4c715c079569 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 200 len: 1325 microversion: 2.1 time: 0.093963 Jun 23 17:32:35.122947 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 627/1274] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:35 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 1325 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:36.145726 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-57855d5e-ac28-40a7-9cd5-60f2b9dcd561 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:36.146956 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-57855d5e-ac28-40a7-9cd5-60f2b9dcd561 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:36.155691 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57855d5e-ac28-40a7-9cd5-60f2b9dcd561 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:36.156136 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57855d5e-ac28-40a7-9cd5-60f2b9dcd561 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:36.156887 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57855d5e-ac28-40a7-9cd5-60f2b9dcd561 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:36.157314 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-57855d5e-ac28-40a7-9cd5-60f2b9dcd561 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:36.170789 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-57855d5e-ac28-40a7-9cd5-60f2b9dcd561 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] HTTP exception thrown: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-57855d5e-ac28-40a7-9cd5-60f2b9dcd561 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Request method failure captured: Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 HTTP/1.1 Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitKK8Vbeot47SDriu1pK8dlQns4mjdWg02tghT6IYyM5UxVETLtMwVJ44jUqmBqRjDc3NFsRPS3MwAyNzGw9pAfwSx61tL7Tmjbk1O5RtPVxjvXIMjcCab1JAJPQ-ZPyF2TWaXvhgtggm3y7lKQ_QWJTzVhDf25r9wxebnisPEFbmEbM Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 1bba540f52204efcb203231d7d780810 Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:32:36.172394 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:32:36.174174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1bba540f52204efcb203231d7d780810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bba540f52204efcb203231d7d780810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1bba540f52204efcb203231d7d780810", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bba540f52204efcb203231d7d780810"}]}] Jun 23 17:32:36.174174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:32:36.174174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 1bba540f52204efcb203231d7d780810 Jun 23 17:32:36.174174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:32:36.174174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-AttachVolumeTestJSON-418135206-project Jun 23 17:32:36.174174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:32:36.174174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:32:36.174174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 2fd5f4bd4834436bace14bcca9768658 Jun 23 17:32:36.174174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-AttachVolumeTestJSON-418135206-project Jun 23 17:32:36.174174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:32:36.174174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:32:36.174174 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '118fd6aa-e870-4729-a2e4-9a44e0a347b6'} Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:32:36.175211 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:32:36.176811 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:32:36.178326 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-57855d5e-ac28-40a7-9cd5-60f2b9dcd561 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Returning 404 to user: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:32:36.178326 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-57855d5e-ac28-40a7-9cd5-60f2b9dcd561 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 404 len: 111 microversion: 2.1 time: 0.035912 Jun 23 17:32:36.178326 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 648/1275] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:36 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:32:36.182781 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0dafb1c3-86e7-41a9-a64f-94b5c7503d69 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '.version_select at 0x7f342e492790>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:36.204740 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0dafb1c3-86e7-41a9-a64f-94b5c7503d69 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-70078279" status: 202 len: 0 microversion: 2.1 time: 0.025702 Jun 23 17:32:36.205297 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 628/1276] 10.222.0.18 () {58 vars in 1214 bytes} [Thu Jun 23 17:32:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-70078279 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:32:36.856338 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-af5d2931-7a5e-4001-8eb4-e097783db21a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Action: 'create', calling method: .version_select at 0x7f342da304c0>, body: {"keypair": {"name": "tempest-keypair-1093794261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTpw5WRw9uUK4HOhEkWpXBgv4mP+SnrSvbbI4uSPjCXw4oDIKq52urslaWFjJY0hqc+lp3sVt4Mtc77CTd6c+1WckHZkTG5Qpg+4u4082Hn69LXSseZG1lrkSqaTA2iOA=="}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:32:36.870398 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-af5d2931-7a5e-4001-8eb4-e097783db21a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Getting quotas for project 1bba540f52204efcb203231d7d780810. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:32:36.874464 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.quota [None req-af5d2931-7a5e-4001-8eb4-e097783db21a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Getting quotas for user 2fd5f4bd4834436bace14bcca9768658 and project 1bba540f52204efcb203231d7d780810. Resources: {'key_pairs'} {{(pid=117897) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:32:36.899884 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-af5d2931-7a5e-4001-8eb4-e097783db21a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047536 Jun 23 17:32:36.900479 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 649/1277] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 23 17:32:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:32:38.211710 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1737082667", "imageRef": "0235e846-46ec-42f7-ab6c-86d8499c63ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aeace213-3fb6-4ee9-a403-3b20d69c9259"}], "security_groups": [{"name": "tempest-securitygroup--1215755720"}], "key_name": "tempest-keypair-1093794261", "user_data": "}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:32:38.314557 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] validate_networks() for [('aeace213-3fb6-4ee9-a403-3b20d69c9259', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 17:32:38.721244 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 17:32:38.721657 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 17:32:38.722155 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 17:32:38.722561 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 17:32:38.722967 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 17:32:38.732303 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:38.732463 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:38.733286 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:38.733721 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:38.750162 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Getting quotas for project 1bba540f52204efcb203231d7d780810. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 17:32:38.754120 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Getting quotas for user 2fd5f4bd4834436bace14bcca9768658 and project 1bba540f52204efcb203231d7d780810. Resources: {'instances', 'ram', 'cores'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 17:32:38.765428 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 17:32:38.767675 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0235e846-46ec-42f7-ab6c-86d8499c63ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 17:32:38.821438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a8d834a8-554d-43bf-8d20-8dfb394f1881 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.614362 Jun 23 17:32:38.822118 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 629/1278] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 23 17:32:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 17:32:38.833037 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-371a9533-4c64-4a30-8105-1b07b9db9543 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:38.834303 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-371a9533-4c64-4a30-8105-1b07b9db9543 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:38.890979 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-371a9533-4c64-4a30-8105-1b07b9db9543 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:38.897960 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-371a9533-4c64-4a30-8105-1b07b9db9543 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1238 microversion: 2.1 time: 0.069484 Jun 23 17:32:38.898524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 650/1279] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:38 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:39.915571 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c7c2826f-2920-4b6e-94a0-0101d7b1db55 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:39.916182 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c7c2826f-2920-4b6e-94a0-0101d7b1db55 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:39.923558 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7c2826f-2920-4b6e-94a0-0101d7b1db55 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:39.924010 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7c2826f-2920-4b6e-94a0-0101d7b1db55 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:39.924776 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7c2826f-2920-4b6e-94a0-0101d7b1db55 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:39.925195 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7c2826f-2920-4b6e-94a0-0101d7b1db55 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:40.012598 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c7c2826f-2920-4b6e-94a0-0101d7b1db55 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:40.024276 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c7c2826f-2920-4b6e-94a0-0101d7b1db55 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1298 microversion: 2.1 time: 0.111617 Jun 23 17:32:40.025024 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 630/1280] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:39 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:41.041963 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-89440113-53fd-463f-8a6b-022c12dcbb74 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:41.042549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-89440113-53fd-463f-8a6b-022c12dcbb74 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:41.050501 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-89440113-53fd-463f-8a6b-022c12dcbb74 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:41.051586 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-89440113-53fd-463f-8a6b-022c12dcbb74 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:41.052481 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-89440113-53fd-463f-8a6b-022c12dcbb74 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:41.053144 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-89440113-53fd-463f-8a6b-022c12dcbb74 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:41.193898 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-89440113-53fd-463f-8a6b-022c12dcbb74 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:41.202634 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-89440113-53fd-463f-8a6b-022c12dcbb74 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1364 microversion: 2.1 time: 0.164842 Jun 23 17:32:41.203951 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 651/1281] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:41 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:41.684526 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-2c626c11-2172-4993-9c73-ea7d98f130ab req-9ed85158-f4ff-4ed4-9444-1775c21cc495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5749b913-d6fd-4d77-9a12-5c3266dfb5f3", "tag": "fd935077-d2fe-409d-99a0-b76e3b106b0c"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:32:41.697906 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-2c626c11-2172-4993-9c73-ea7d98f130ab req-9ed85158-f4ff-4ed4-9444-1775c21cc495 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:41.703198 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-2c626c11-2172-4993-9c73-ea7d98f130ab req-9ed85158-f4ff-4ed4-9444-1775c21cc495 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:41.717440 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-2c626c11-2172-4993-9c73-ea7d98f130ab req-9ed85158-f4ff-4ed4-9444-1775c21cc495 service nova] Creating event network-changed:fd935077-d2fe-409d-99a0-b76e3b106b0c for instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 on hv-cinder-83538 Jun 23 17:32:41.723116 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-2c626c11-2172-4993-9c73-ea7d98f130ab req-9ed85158-f4ff-4ed4-9444-1775c21cc495 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043649 Jun 23 17:32:41.724291 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 631/1282] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:32:42.221025 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-70dce59f-60e5-4d45-abc1-fe35308a0d7d tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:42.221668 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-70dce59f-60e5-4d45-abc1-fe35308a0d7d tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:42.228629 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-70dce59f-60e5-4d45-abc1-fe35308a0d7d tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:42.229076 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-70dce59f-60e5-4d45-abc1-fe35308a0d7d tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:42.229936 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-70dce59f-60e5-4d45-abc1-fe35308a0d7d tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:42.230301 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-70dce59f-60e5-4d45-abc1-fe35308a0d7d tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:42.365419 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-70dce59f-60e5-4d45-abc1-fe35308a0d7d tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:42.373068 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-70dce59f-60e5-4d45-abc1-fe35308a0d7d tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1364 microversion: 2.1 time: 0.156069 Jun 23 17:32:42.373603 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 652/1283] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:42 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:43.401544 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5fbacf25-d8a2-4b74-aa15-1f643b0004cb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:43.402676 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5fbacf25-d8a2-4b74-aa15-1f643b0004cb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:43.410211 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fbacf25-d8a2-4b74-aa15-1f643b0004cb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:43.410662 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fbacf25-d8a2-4b74-aa15-1f643b0004cb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:43.411420 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fbacf25-d8a2-4b74-aa15-1f643b0004cb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:43.411852 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fbacf25-d8a2-4b74-aa15-1f643b0004cb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:43.551835 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5fbacf25-d8a2-4b74-aa15-1f643b0004cb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:43.561514 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5fbacf25-d8a2-4b74-aa15-1f643b0004cb tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1364 microversion: 2.1 time: 0.168020 Jun 23 17:32:43.562540 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 632/1284] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:43 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:44.579480 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-e66fb276-fa53-403b-b58a-0a4262b5576f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:44.580063 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-e66fb276-fa53-403b-b58a-0a4262b5576f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:44.586631 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e66fb276-fa53-403b-b58a-0a4262b5576f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:44.587075 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e66fb276-fa53-403b-b58a-0a4262b5576f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:44.587886 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e66fb276-fa53-403b-b58a-0a4262b5576f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:44.588314 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-e66fb276-fa53-403b-b58a-0a4262b5576f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:44.728555 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-e66fb276-fa53-403b-b58a-0a4262b5576f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:44.736702 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-e66fb276-fa53-403b-b58a-0a4262b5576f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1364 microversion: 2.1 time: 0.161434 Jun 23 17:32:44.737275 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 653/1285] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:44 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:45.755105 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-715c16b7-4d4f-41bb-969d-e7351f84dab2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:45.755752 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-715c16b7-4d4f-41bb-969d-e7351f84dab2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:45.762605 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-715c16b7-4d4f-41bb-969d-e7351f84dab2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:45.763056 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-715c16b7-4d4f-41bb-969d-e7351f84dab2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:45.763835 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-715c16b7-4d4f-41bb-969d-e7351f84dab2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:45.764267 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-715c16b7-4d4f-41bb-969d-e7351f84dab2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:45.905893 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-715c16b7-4d4f-41bb-969d-e7351f84dab2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:45.913428 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-715c16b7-4d4f-41bb-969d-e7351f84dab2 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1364 microversion: 2.1 time: 0.163393 Jun 23 17:32:45.914064 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 633/1286] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:45 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:46.933549 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6f374b37-3ddc-41c5-99c1-67538e10f017 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:46.934620 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6f374b37-3ddc-41c5-99c1-67538e10f017 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:46.946239 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6f374b37-3ddc-41c5-99c1-67538e10f017 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:46.946872 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6f374b37-3ddc-41c5-99c1-67538e10f017 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:46.948114 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6f374b37-3ddc-41c5-99c1-67538e10f017 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:46.948822 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6f374b37-3ddc-41c5-99c1-67538e10f017 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:47.083683 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-6f374b37-3ddc-41c5-99c1-67538e10f017 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:47.091618 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6f374b37-3ddc-41c5-99c1-67538e10f017 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1364 microversion: 2.1 time: 0.164626 Jun 23 17:32:47.092182 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 654/1287] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:46 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:47.886060 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-bbb73c54-607b-41fc-9a91-6516af60e681 req-33ffe9d0-73ef-4701-8509-26c19b0ba9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5749b913-d6fd-4d77-9a12-5c3266dfb5f3", "name": "network-vif-plugged", "status": "completed", "tag": "fd935077-d2fe-409d-99a0-b76e3b106b0c"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:32:47.895134 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-bbb73c54-607b-41fc-9a91-6516af60e681 req-33ffe9d0-73ef-4701-8509-26c19b0ba9d1 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:47.895584 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-bbb73c54-607b-41fc-9a91-6516af60e681 req-33ffe9d0-73ef-4701-8509-26c19b0ba9d1 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:47.907593 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-bbb73c54-607b-41fc-9a91-6516af60e681 req-33ffe9d0-73ef-4701-8509-26c19b0ba9d1 service nova] Creating event network-vif-plugged:fd935077-d2fe-409d-99a0-b76e3b106b0c for instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 on hv-cinder-83538 Jun 23 17:32:47.912815 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-bbb73c54-607b-41fc-9a91-6516af60e681 req-33ffe9d0-73ef-4701-8509-26c19b0ba9d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088455 Jun 23 17:32:47.913379 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 634/1288] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:32:48.108765 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-282d3aa1-4422-4389-9889-286be97d7384 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:48.109409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-282d3aa1-4422-4389-9889-286be97d7384 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:48.116436 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-282d3aa1-4422-4389-9889-286be97d7384 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:48.116889 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-282d3aa1-4422-4389-9889-286be97d7384 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:48.117659 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-282d3aa1-4422-4389-9889-286be97d7384 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:48.118136 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-282d3aa1-4422-4389-9889-286be97d7384 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:48.251826 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-282d3aa1-4422-4389-9889-286be97d7384 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:48.259649 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-282d3aa1-4422-4389-9889-286be97d7384 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1364 microversion: 2.1 time: 0.154845 Jun 23 17:32:48.260225 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 655/1289] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:48 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:49.280302 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0c2c14bb-20da-4c28-9085-e1368acf8c9e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:49.281065 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0c2c14bb-20da-4c28-9085-e1368acf8c9e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:49.283180 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:32:49.283833 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:32:49.290737 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c2c14bb-20da-4c28-9085-e1368acf8c9e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:49.291180 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c2c14bb-20da-4c28-9085-e1368acf8c9e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:49.291968 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c2c14bb-20da-4c28-9085-e1368acf8c9e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:49.292390 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0c2c14bb-20da-4c28-9085-e1368acf8c9e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:49.428271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0c2c14bb-20da-4c28-9085-e1368acf8c9e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:49.436638 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0c2c14bb-20da-4c28-9085-e1368acf8c9e tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1364 microversion: 2.1 time: 0.161124 Jun 23 17:32:49.437744 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 635/1290] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:49 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:50.456628 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-8f6a541d-b439-4bc2-b690-a1dfa980ba1a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:50.457305 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-8f6a541d-b439-4bc2-b690-a1dfa980ba1a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:50.459504 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell0:SELECT=6 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:32:50.466810 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8f6a541d-b439-4bc2-b690-a1dfa980ba1a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:50.467340 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8f6a541d-b439-4bc2-b690-a1dfa980ba1a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:50.468235 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8f6a541d-b439-4bc2-b690-a1dfa980ba1a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:50.468747 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-8f6a541d-b439-4bc2-b690-a1dfa980ba1a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:50.613699 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-8f6a541d-b439-4bc2-b690-a1dfa980ba1a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:32:50.621818 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-8f6a541d-b439-4bc2-b690-a1dfa980ba1a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1550 microversion: 2.1 time: 0.170892 Jun 23 17:32:50.622430 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 656/1291] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:32:50 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1550 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:32:50.638799 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-158f5428-c24e-423f-a84c-4f789cc918e5 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:32:50.639380 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-158f5428-c24e-423f-a84c-4f789cc918e5 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:32:50.646203 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-158f5428-c24e-423f-a84c-4f789cc918e5 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:50.646660 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-158f5428-c24e-423f-a84c-4f789cc918e5 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:50.647421 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-158f5428-c24e-423f-a84c-4f789cc918e5 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:50.647855 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-158f5428-c24e-423f-a84c-4f789cc918e5 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:50.725622 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-158f5428-c24e-423f-a84c-4f789cc918e5 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090686 Jun 23 17:32:50.726231 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 636/1292] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 23 17:32:50 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:32:51.649943 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [req-cfee1105-da77-47c3-a6b3-24e5bcbb4299 req-07232d4a-b482-4f52-b0a8-0e8056bb7540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5749b913-d6fd-4d77-9a12-5c3266dfb5f3", "tag": "fd935077-d2fe-409d-99a0-b76e3b106b0c"}]} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:32:51.660383 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-cfee1105-da77-47c3-a6b3-24e5bcbb4299 req-07232d4a-b482-4f52-b0a8-0e8056bb7540 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:32:51.660901 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [req-cfee1105-da77-47c3-a6b3-24e5bcbb4299 req-07232d4a-b482-4f52-b0a8-0e8056bb7540 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:32:51.672290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.compute.server_external_events [req-cfee1105-da77-47c3-a6b3-24e5bcbb4299 req-07232d4a-b482-4f52-b0a8-0e8056bb7540 service nova] Creating event network-changed:fd935077-d2fe-409d-99a0-b76e3b106b0c for instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 on hv-cinder-83538 Jun 23 17:32:51.677340 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [req-cfee1105-da77-47c3-a6b3-24e5bcbb4299 req-07232d4a-b482-4f52-b0a8-0e8056bb7540 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031148 Jun 23 17:32:51.677961 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 657/1293] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:33:49.228099 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:33:49.229780 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Thu Jun 23 17:33:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:34:06.927545 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:06.928319 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=60 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:06.981824 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3a818980-1c29-40dd-bec3-22d0304814d1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:06.982312 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3a818980-1c29-40dd-bec3-22d0304814d1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:06.990507 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3a818980-1c29-40dd-bec3-22d0304814d1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:06.991122 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3a818980-1c29-40dd-bec3-22d0304814d1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:06.992269 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3a818980-1c29-40dd-bec3-22d0304814d1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:06.992892 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3a818980-1c29-40dd-bec3-22d0304814d1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:07.025965 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3a818980-1c29-40dd-bec3-22d0304814d1 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/ips" status: 200 len: 146 microversion: 2.1 time: 0.100786 Jun 23 17:34:07.026508 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 637/1294] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 23 17:34:06 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/ips => generated 146 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:34:08.380333 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:08.381315 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:08.389980 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-5bb4e4a8-11cc-44ee-ae64-8782a3f6749f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06c23129-9dc8-487c-aace-f45eace0769a"}} {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:34:08.393307 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-5bb4e4a8-11cc-44ee-ae64-8782a3f6749f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:08.405760 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5bb4e4a8-11cc-44ee-ae64-8782a3f6749f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:08.406150 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5bb4e4a8-11cc-44ee-ae64-8782a3f6749f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:08.406909 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5bb4e4a8-11cc-44ee-ae64-8782a3f6749f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:08.407369 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-5bb4e4a8-11cc-44ee-ae64-8782a3f6749f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:08.845147 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-5bb4e4a8-11cc-44ee-ae64-8782a3f6749f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "POST /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467964 Jun 23 17:34:08.845850 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 658/1295] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 23 17:34:08 2022] POST /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:34:16.401714 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f3cf78fb-2d71-4fad-9784-28e6aa602441 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:16.403324 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f3cf78fb-2d71-4fad-9784-28e6aa602441 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:16.411646 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f3cf78fb-2d71-4fad-9784-28e6aa602441 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:16.412011 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f3cf78fb-2d71-4fad-9784-28e6aa602441 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:16.412788 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f3cf78fb-2d71-4fad-9784-28e6aa602441 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:16.413201 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f3cf78fb-2d71-4fad-9784-28e6aa602441 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:16.444976 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f3cf78fb-2d71-4fad-9784-28e6aa602441 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049472 Jun 23 17:34:16.445530 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 638/1296] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:34:16 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:34:16.459893 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-9d252c0a-6b95-452d-b7c5-e91012d62d38 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:16.460517 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-9d252c0a-6b95-452d-b7c5-e91012d62d38 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:16.466827 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9d252c0a-6b95-452d-b7c5-e91012d62d38 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:16.467272 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9d252c0a-6b95-452d-b7c5-e91012d62d38 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:16.468027 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9d252c0a-6b95-452d-b7c5-e91012d62d38 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:16.468463 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-9d252c0a-6b95-452d-b7c5-e91012d62d38 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:16.497326 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-9d252c0a-6b95-452d-b7c5-e91012d62d38 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments/06c23129-9dc8-487c-aace-f45eace0769a" status: 200 len: 194 microversion: 2.1 time: 0.044667 Jun 23 17:34:16.497913 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 659/1297] 10.222.0.18 () {58 vars in 1412 bytes} [Thu Jun 23 17:34:16 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments/06c23129-9dc8-487c-aace-f45eace0769a => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:34:17.842207 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1ae38465-a3b0-4580-9b87-a46b51125de7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4365d48-6d2d-4993-9338-2d0ef1317e81"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:34:17.843404 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1ae38465-a3b0-4580-9b87-a46b51125de7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:17.852262 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1ae38465-a3b0-4580-9b87-a46b51125de7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:17.852714 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1ae38465-a3b0-4580-9b87-a46b51125de7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:17.853474 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1ae38465-a3b0-4580-9b87-a46b51125de7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:17.853946 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1ae38465-a3b0-4580-9b87-a46b51125de7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:18.190438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1ae38465-a3b0-4580-9b87-a46b51125de7 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "POST /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354219 Jun 23 17:34:18.191081 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 639/1298] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 23 17:34:17 2022] POST /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:34:25.719810 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-70d1a439-36bc-45e9-b65a-c6a5b76c9bcf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:25.720727 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-70d1a439-36bc-45e9-b65a-c6a5b76c9bcf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:25.727456 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-70d1a439-36bc-45e9-b65a-c6a5b76c9bcf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:25.727893 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-70d1a439-36bc-45e9-b65a-c6a5b76c9bcf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:25.728636 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-70d1a439-36bc-45e9-b65a-c6a5b76c9bcf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:25.729077 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-70d1a439-36bc-45e9-b65a-c6a5b76c9bcf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:25.758511 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-70d1a439-36bc-45e9-b65a-c6a5b76c9bcf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042542 Jun 23 17:34:25.759052 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 660/1299] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:34:25 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:34:25.913734 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-78ea8414-0366-4064-a5ad-efac21f625e3 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:25.915283 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-78ea8414-0366-4064-a5ad-efac21f625e3 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:25.925712 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78ea8414-0366-4064-a5ad-efac21f625e3 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:25.926511 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78ea8414-0366-4064-a5ad-efac21f625e3 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:25.927775 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78ea8414-0366-4064-a5ad-efac21f625e3 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:25.928488 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78ea8414-0366-4064-a5ad-efac21f625e3 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:25.958813 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-78ea8414-0366-4064-a5ad-efac21f625e3 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments/06c23129-9dc8-487c-aace-f45eace0769a" status: 200 len: 194 microversion: 2.1 time: 0.053288 Jun 23 17:34:25.959396 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 640/1300] 10.222.0.18 () {58 vars in 1412 bytes} [Thu Jun 23 17:34:25 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments/06c23129-9dc8-487c-aace-f45eace0769a => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:34:25.972509 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-6e5e9283-8f0d-4f06-8efa-0e6ca2e0cc2f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:25.973309 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-6e5e9283-8f0d-4f06-8efa-0e6ca2e0cc2f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:25.983165 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e5e9283-8f0d-4f06-8efa-0e6ca2e0cc2f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:25.983822 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e5e9283-8f0d-4f06-8efa-0e6ca2e0cc2f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:25.984952 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e5e9283-8f0d-4f06-8efa-0e6ca2e0cc2f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:25.985591 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-6e5e9283-8f0d-4f06-8efa-0e6ca2e0cc2f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:26.069098 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-6e5e9283-8f0d-4f06-8efa-0e6ca2e0cc2f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lazy-loading 'services' on Instance uuid 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:34:26.165057 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-6e5e9283-8f0d-4f06-8efa-0e6ca2e0cc2f tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments/06c23129-9dc8-487c-aace-f45eace0769a" status: 202 len: 0 microversion: 2.1 time: 0.198230 Jun 23 17:34:26.165878 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 661/1301] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 23 17:34:25 2022] DELETE /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments/06c23129-9dc8-487c-aace-f45eace0769a => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:34:28.345988 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1d2d70ba-2745-4a67-8375-44001eefc7b0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:28.346555 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1d2d70ba-2745-4a67-8375-44001eefc7b0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:28.355575 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1d2d70ba-2745-4a67-8375-44001eefc7b0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:28.356246 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1d2d70ba-2745-4a67-8375-44001eefc7b0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:28.357446 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1d2d70ba-2745-4a67-8375-44001eefc7b0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:28.358022 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1d2d70ba-2745-4a67-8375-44001eefc7b0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:28.390956 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1d2d70ba-2745-4a67-8375-44001eefc7b0 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments/b4365d48-6d2d-4993-9338-2d0ef1317e81" status: 200 len: 194 microversion: 2.1 time: 0.049032 Jun 23 17:34:28.391533 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 641/1302] 10.222.0.18 () {58 vars in 1412 bytes} [Thu Jun 23 17:34:28 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments/b4365d48-6d2d-4993-9338-2d0ef1317e81 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:34:28.408438 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-3966ff64-e3ad-4978-ab0d-4e9c6df1aa2a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:28.408981 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-3966ff64-e3ad-4978-ab0d-4e9c6df1aa2a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:28.417002 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3966ff64-e3ad-4978-ab0d-4e9c6df1aa2a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:28.417379 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3966ff64-e3ad-4978-ab0d-4e9c6df1aa2a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:28.418188 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3966ff64-e3ad-4978-ab0d-4e9c6df1aa2a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:28.418640 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-3966ff64-e3ad-4978-ab0d-4e9c6df1aa2a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:28.502052 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-3966ff64-e3ad-4978-ab0d-4e9c6df1aa2a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lazy-loading 'services' on Instance uuid 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:34:28.577923 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-3966ff64-e3ad-4978-ab0d-4e9c6df1aa2a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments/b4365d48-6d2d-4993-9338-2d0ef1317e81" status: 202 len: 0 microversion: 2.1 time: 0.176924 Jun 23 17:34:28.578493 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 662/1303] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 23 17:34:28 2022] DELETE /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments/b4365d48-6d2d-4993-9338-2d0ef1317e81 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:34:29.750754 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0bc32b2b-4655-43f5-999f-1f0938643d43 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:29.751741 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0bc32b2b-4655-43f5-999f-1f0938643d43 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:29.758901 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bc32b2b-4655-43f5-999f-1f0938643d43 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:29.759349 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bc32b2b-4655-43f5-999f-1f0938643d43 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:29.760111 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bc32b2b-4655-43f5-999f-1f0938643d43 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:29.760541 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bc32b2b-4655-43f5-999f-1f0938643d43 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:29.789537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0bc32b2b-4655-43f5-999f-1f0938643d43 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042791 Jun 23 17:34:29.790097 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 642/1304] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:34:29 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 17:34:29.897758 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-4705d276-aa2a-465e-9ade-74ce0f34b731 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:29.898796 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-4705d276-aa2a-465e-9ade-74ce0f34b731 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:29.905563 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4705d276-aa2a-465e-9ade-74ce0f34b731 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:29.906043 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4705d276-aa2a-465e-9ade-74ce0f34b731 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:29.906781 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4705d276-aa2a-465e-9ade-74ce0f34b731 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:29.907203 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-4705d276-aa2a-465e-9ade-74ce0f34b731 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:29.934977 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-4705d276-aa2a-465e-9ade-74ce0f34b731 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041686 Jun 23 17:34:29.935523 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 663/1305] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 23 17:34:29 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 17:34:29.998850 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-338ff9b6-7cc7-4a2e-ad02-f4906f2b4f20 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:29.999345 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-338ff9b6-7cc7-4a2e-ad02-f4906f2b4f20 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:30.005491 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-338ff9b6-7cc7-4a2e-ad02-f4906f2b4f20 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:30.005995 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-338ff9b6-7cc7-4a2e-ad02-f4906f2b4f20 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:30.006746 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-338ff9b6-7cc7-4a2e-ad02-f4906f2b4f20 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:30.007180 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-338ff9b6-7cc7-4a2e-ad02-f4906f2b4f20 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:30.034950 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-338ff9b6-7cc7-4a2e-ad02-f4906f2b4f20 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 17:34:30.120573 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-338ff9b6-7cc7-4a2e-ad02-f4906f2b4f20 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 204 len: 0 microversion: 2.1 time: 0.125376 Jun 23 17:34:30.121342 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 643/1306] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:34:29 2022] DELETE /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 17:34:30.129741 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-f90918b1-b0cf-439a-bc4b-e5497db1d887 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:30.130413 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-f90918b1-b0cf-439a-bc4b-e5497db1d887 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:30.136719 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f90918b1-b0cf-439a-bc4b-e5497db1d887 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:30.137160 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f90918b1-b0cf-439a-bc4b-e5497db1d887 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:30.137958 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f90918b1-b0cf-439a-bc4b-e5497db1d887 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:30.138387 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-f90918b1-b0cf-439a-bc4b-e5497db1d887 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:30.276875 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-f90918b1-b0cf-439a-bc4b-e5497db1d887 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:34:30.288323 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-f90918b1-b0cf-439a-bc4b-e5497db1d887 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1675 microversion: 2.1 time: 0.162203 Jun 23 17:34:30.289192 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 664/1307] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:34:30 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:34:31.311397 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c1aa658c-8a4b-452f-b9d9-fe98fdf71ebf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:31.312927 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c1aa658c-8a4b-452f-b9d9-fe98fdf71ebf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:31.323784 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c1aa658c-8a4b-452f-b9d9-fe98fdf71ebf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:31.324535 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c1aa658c-8a4b-452f-b9d9-fe98fdf71ebf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:31.325840 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c1aa658c-8a4b-452f-b9d9-fe98fdf71ebf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:31.326560 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c1aa658c-8a4b-452f-b9d9-fe98fdf71ebf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:31.464174 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c1aa658c-8a4b-452f-b9d9-fe98fdf71ebf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:34:31.471923 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c1aa658c-8a4b-452f-b9d9-fe98fdf71ebf tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1675 microversion: 2.1 time: 0.167791 Jun 23 17:34:31.472498 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 644/1308] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:34:31 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:34:32.490246 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-b3dba27a-a34e-4da6-a019-67bc896fc662 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:32.490843 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-b3dba27a-a34e-4da6-a019-67bc896fc662 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:32.497739 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b3dba27a-a34e-4da6-a019-67bc896fc662 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:32.498225 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b3dba27a-a34e-4da6-a019-67bc896fc662 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:32.498994 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b3dba27a-a34e-4da6-a019-67bc896fc662 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:32.499425 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-b3dba27a-a34e-4da6-a019-67bc896fc662 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:32.635763 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-b3dba27a-a34e-4da6-a019-67bc896fc662 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:34:32.643925 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-b3dba27a-a34e-4da6-a019-67bc896fc662 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1675 microversion: 2.1 time: 0.157871 Jun 23 17:34:32.644524 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 665/1309] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:34:32 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:34:33.371153 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-d0c0a055-36f7-4dbd-8ecc-fbd1ab6de858 req-c07dc2bc-6687-48f1-a49f-888642c53582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5749b913-d6fd-4d77-9a12-5c3266dfb5f3", "name": "network-vif-deleted", "tag": "fd935077-d2fe-409d-99a0-b76e3b106b0c"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 17:34:33.380027 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d0c0a055-36f7-4dbd-8ecc-fbd1ab6de858 req-c07dc2bc-6687-48f1-a49f-888642c53582 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:33.380473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d0c0a055-36f7-4dbd-8ecc-fbd1ab6de858 req-c07dc2bc-6687-48f1-a49f-888642c53582 service nova] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:33.396050 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-d0c0a055-36f7-4dbd-8ecc-fbd1ab6de858 req-c07dc2bc-6687-48f1-a49f-888642c53582 service nova] Creating event network-vif-deleted:fd935077-d2fe-409d-99a0-b76e3b106b0c for instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 on hv-cinder-83538 Jun 23 17:34:33.408523 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-d0c0a055-36f7-4dbd-8ecc-fbd1ab6de858 req-c07dc2bc-6687-48f1-a49f-888642c53582 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097136 Jun 23 17:34:33.409632 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 645/1310] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 23 17:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 17:34:33.660802 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-c4a946a8-1a19-4eb1-afa0-1cbdf27b076a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:33.661395 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-c4a946a8-1a19-4eb1-afa0-1cbdf27b076a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:33.668494 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c4a946a8-1a19-4eb1-afa0-1cbdf27b076a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:33.668944 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c4a946a8-1a19-4eb1-afa0-1cbdf27b076a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:33.669711 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c4a946a8-1a19-4eb1-afa0-1cbdf27b076a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:33.670254 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c4a946a8-1a19-4eb1-afa0-1cbdf27b076a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:33.705410 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c4a946a8-1a19-4eb1-afa0-1cbdf27b076a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:33.705886 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-c4a946a8-1a19-4eb1-afa0-1cbdf27b076a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:33.706473 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.objects.instance [None req-c4a946a8-1a19-4eb1-afa0-1cbdf27b076a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lazy-loading 'fault' on Instance uuid 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 {{(pid=117897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 17:34:33.753639 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.policy [None req-c4a946a8-1a19-4eb1-afa0-1cbdf27b076a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd5f4bd4834436bace14bcca9768658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bba540f52204efcb203231d7d780810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117897) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 17:34:33.763384 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-c4a946a8-1a19-4eb1-afa0-1cbdf27b076a tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 200 len: 1328 microversion: 2.1 time: 0.106393 Jun 23 17:34:33.771131 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 666/1311] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:34:33 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 1328 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 17:34:34.786106 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e6791d08-4aaf-4baf-a3e4-7d85dd4477fa tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:34.787257 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e6791d08-4aaf-4baf-a3e4-7d85dd4477fa tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:34.798092 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e6791d08-4aaf-4baf-a3e4-7d85dd4477fa tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:34.798835 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e6791d08-4aaf-4baf-a3e4-7d85dd4477fa tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:34.800055 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e6791d08-4aaf-4baf-a3e4-7d85dd4477fa tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:34.800805 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e6791d08-4aaf-4baf-a3e4-7d85dd4477fa tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:34.816563 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-e6791d08-4aaf-4baf-a3e4-7d85dd4477fa tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] HTTP exception thrown: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e6791d08-4aaf-4baf-a3e4-7d85dd4477fa tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Request method failure captured: Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 HTTP/1.1 Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitKK8Vbeot47SDriu1pK8dlQns4mjdWg02tghT6IYyM5UxVETLtMwVJ44jUqmBqRjDc3NFsRPS3MwAyNzGw9pAfwSx61tL7Tmjbk1O5RtPVxjvXIMjcCab1JAJPQ-ZPyF2TWaXvhgtggm3y7lKQ_QWJTzVhDf25r9wxebnisPEFbmEbM Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: 1bba540f52204efcb203231d7d780810 Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:34:34.818214 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:34:34.820019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1bba540f52204efcb203231d7d780810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bba540f52204efcb203231d7d780810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1bba540f52204efcb203231d7d780810", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bba540f52204efcb203231d7d780810"}]}] Jun 23 17:34:34.820019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:34.820019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 1bba540f52204efcb203231d7d780810 Jun 23 17:34:34.820019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:34.820019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeTestJSON-418135206-project Jun 23 17:34:34.820019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:34:34.820019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:34:34.820019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: 2fd5f4bd4834436bace14bcca9768658 Jun 23 17:34:34.820019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeTestJSON-418135206-project Jun 23 17:34:34.820019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:34:34.820019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:34.820019 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '5749b913-d6fd-4d77-9a12-5c3266dfb5f3'} Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:34:34.821537 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:34.823037 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:34.824343 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e6791d08-4aaf-4baf-a3e4-7d85dd4477fa tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Returning 404 to user: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:34:34.824343 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e6791d08-4aaf-4baf-a3e4-7d85dd4477fa tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 404 len: 111 microversion: 2.1 time: 0.041397 Jun 23 17:34:34.824343 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 646/1312] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:34:34 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:34:34.828591 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-0aab5e59-48d7-4b9b-a101-9bb54d8a93d8 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '.version_select at 0x7f342d978dc0>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:34.849467 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-0aab5e59-48d7-4b9b-a101-9bb54d8a93d8 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1093794261" status: 202 len: 0 microversion: 2.1 time: 0.024697 Jun 23 17:34:34.850088 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 667/1313] 10.222.0.18 () {58 vars in 1220 bytes} [Thu Jun 23 17:34:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1093794261 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 17:34:37.806425 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f078b664-f98f-407e-add9-ebe820800d45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:37.807148 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f078b664-f98f-407e-add9-ebe820800d45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:37.809658 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:37.815715 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f078b664-f98f-407e-add9-ebe820800d45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:37.816160 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f078b664-f98f-407e-add9-ebe820800d45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:37.816922 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f078b664-f98f-407e-add9-ebe820800d45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:37.817355 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f078b664-f98f-407e-add9-ebe820800d45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:37.820854 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:37.834132 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-f078b664-f98f-407e-add9-ebe820800d45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] HTTP exception thrown: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f078b664-f98f-407e-add9-ebe820800d45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Request method failure captured: Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: DELETE /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 HTTP/1.1 Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitKK8Vbeot47SDriu1pK8dlQns4mjdWg02tghT6IYyM5UxVETLtMwVJ44jUqmBqRjDc3NFsRPS3MwAyNzGw9pAfwSx61tL7Tmjbk1O5RtPVxjvXIMjcCab1JAJPQ-ZPyF2TWaXvhgtggm3y7lKQ_QWJTzVhDf25r9wxebnisPEFbmEbM Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: 1bba540f52204efcb203231d7d780810 Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:34:37.835921 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:34:37.837581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1bba540f52204efcb203231d7d780810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bba540f52204efcb203231d7d780810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1bba540f52204efcb203231d7d780810", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bba540f52204efcb203231d7d780810"}]}] Jun 23 17:34:37.837581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:37.837581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 1bba540f52204efcb203231d7d780810 Jun 23 17:34:37.837581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:37.837581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeTestJSON-418135206-project Jun 23 17:34:37.837581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:34:37.837581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:34:37.837581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: 2fd5f4bd4834436bace14bcca9768658 Jun 23 17:34:37.837581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeTestJSON-418135206-project Jun 23 17:34:37.837581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:34:37.837581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:37.837581 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '5749b913-d6fd-4d77-9a12-5c3266dfb5f3'} Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:34:37.841637 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:37.843438 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:37.845110 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f078b664-f98f-407e-add9-ebe820800d45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Returning 404 to user: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:34:37.845110 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f078b664-f98f-407e-add9-ebe820800d45 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 404 len: 111 microversion: 2.1 time: 0.035776 Jun 23 17:34:37.845110 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 647/1314] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:34:37 2022] DELETE /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:34:37.846828 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a863269b-390b-4fea-9a79-0944c254e582 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:37.847434 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-a863269b-390b-4fea-9a79-0944c254e582 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 5749b913-d6fd-4d77-9a12-5c3266dfb5f3] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:37.854874 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a863269b-390b-4fea-9a79-0944c254e582 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:37.855326 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a863269b-390b-4fea-9a79-0944c254e582 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:37.856094 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a863269b-390b-4fea-9a79-0944c254e582 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:37.856558 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-a863269b-390b-4fea-9a79-0944c254e582 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:37.870241 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-a863269b-390b-4fea-9a79-0944c254e582 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] HTTP exception thrown: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a863269b-390b-4fea-9a79-0944c254e582 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Request method failure captured: Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 HTTP/1.1 Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitKK8Vbeot47SDriu1pK8dlQns4mjdWg02tghT6IYyM5UxVETLtMwVJ44jUqmBqRjDc3NFsRPS3MwAyNzGw9pAfwSx61tL7Tmjbk1O5RtPVxjvXIMjcCab1JAJPQ-ZPyF2TWaXvhgtggm3y7lKQ_QWJTzVhDf25r9wxebnisPEFbmEbM Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 1bba540f52204efcb203231d7d780810 Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:34:37.871877 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:34:37.873650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1bba540f52204efcb203231d7d780810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bba540f52204efcb203231d7d780810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1bba540f52204efcb203231d7d780810", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bba540f52204efcb203231d7d780810"}]}] Jun 23 17:34:37.873650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:37.873650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 1bba540f52204efcb203231d7d780810 Jun 23 17:34:37.873650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:37.873650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-AttachVolumeTestJSON-418135206-project Jun 23 17:34:37.873650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:34:37.873650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:34:37.873650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 2fd5f4bd4834436bace14bcca9768658 Jun 23 17:34:37.873650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-AttachVolumeTestJSON-418135206-project Jun 23 17:34:37.873650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:34:37.873650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:37.873650 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '5749b913-d6fd-4d77-9a12-5c3266dfb5f3'} Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:34:37.874795 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. Jun 23 17:34:37.876390 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:34:37.878003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-a863269b-390b-4fea-9a79-0944c254e582 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Returning 404 to user: Instance 5749b913-d6fd-4d77-9a12-5c3266dfb5f3 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:34:37.878003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-a863269b-390b-4fea-9a79-0944c254e582 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3" status: 404 len: 111 microversion: 2.1 time: 0.031117 Jun 23 17:34:37.878003 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 668/1315] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:34:37 2022] GET /compute/v2.1/servers/5749b913-d6fd-4d77-9a12-5c3266dfb5f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:34:39.018323 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e6633f40-f00e-4b51-94fa-8a50365efa42 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:39.018833 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e6633f40-f00e-4b51-94fa-8a50365efa42 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:39.026150 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e6633f40-f00e-4b51-94fa-8a50365efa42 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:39.026752 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e6633f40-f00e-4b51-94fa-8a50365efa42 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:39.027558 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e6633f40-f00e-4b51-94fa-8a50365efa42 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:39.027985 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e6633f40-f00e-4b51-94fa-8a50365efa42 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:39.041718 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-e6633f40-f00e-4b51-94fa-8a50365efa42 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] HTTP exception thrown: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e6633f40-f00e-4b51-94fa-8a50365efa42 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Request method failure captured: Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: request: DELETE /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 HTTP/1.1 Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept: application/json Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Connection: close Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Length: 0 Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Content-Type: application/json Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Host: 10.222.0.18 Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.9 Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABitKK8Vbeot47SDriu1pK8dlQns4mjdWg02tghT6IYyM5UxVETLtMwVJ44jUqmBqRjDc3NFsRPS3MwAyNzGw9pAfwSx61tL7Tmjbk1O5RtPVxjvXIMjcCab1JAJPQ-ZPyF2TWaXvhgtggm3y7lKQ_QWJTzVhDf25r9wxebnisPEFbmEbM Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Id: 1bba540f52204efcb203231d7d780810 Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Role: reader,member Jun 23 17:34:39.043516 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Jun 23 17:34:39.045206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1bba540f52204efcb203231d7d780810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bba540f52204efcb203231d7d780810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1bba540f52204efcb203231d7d780810", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bba540f52204efcb203231d7d780810"}]}] Jun 23 17:34:39.045206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:39.045206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 1bba540f52204efcb203231d7d780810 Jun 23 17:34:39.045206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:39.045206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeTestJSON-418135206-project Jun 23 17:34:39.045206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Jun 23 17:34:39.045206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Jun 23 17:34:39.045206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Id: 2fd5f4bd4834436bace14bcca9768658 Jun 23 17:34:39.045206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeTestJSON-418135206-project Jun 23 17:34:39.045206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: method: > Jun 23 17:34:39.045206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: exception: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:34:39.045206 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: action_args: {'id': '118fd6aa-e870-4729-a2e4-9a44e0a347b6'} Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:34:39.049271 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:34:39.051020 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Jun 23 17:34:39.052668 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e6633f40-f00e-4b51-94fa-8a50365efa42 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Returning 404 to user: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:34:39.052668 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e6633f40-f00e-4b51-94fa-8a50365efa42 tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "DELETE /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 404 len: 111 microversion: 2.1 time: 0.030515 Jun 23 17:34:39.052668 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 648/1316] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 23 17:34:39 2022] DELETE /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 17:34:39.053660 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-aafa5335-9de9-46f8-9a1c-1ba1f86aa83c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Calling method '>' {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 17:34:39.054331 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.compute.api [None req-aafa5335-9de9-46f8-9a1c-1ba1f86aa83c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] [instance: 118fd6aa-e870-4729-a2e4-9a44e0a347b6] Fetching instance by UUID {{(pid=117897) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 17:34:39.056797 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:39.062722 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-aafa5335-9de9-46f8-9a1c-1ba1f86aa83c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:39.063157 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-aafa5335-9de9-46f8-9a1c-1ba1f86aa83c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:39.063941 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-aafa5335-9de9-46f8-9a1c-1ba1f86aa83c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 17:34:39.064362 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG oslo_concurrency.lockutils [None req-aafa5335-9de9-46f8-9a1c-1ba1f86aa83c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Lock "d03b830d-8c4e-49e2-9a0f-91b2a277455e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 17:34:39.067594 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG dbcounter [-] [117897] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:39.082513 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.wsgi [None req-aafa5335-9de9-46f8-9a1c-1ba1f86aa83c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] HTTP exception thrown: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-aafa5335-9de9-46f8-9a1c-1ba1f86aa83c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Request method failure captured: Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: request: GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 HTTP/1.1 Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept: application/json Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Accept-Encoding: identity Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Connection: close Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Length: 0 Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Content-Type: application/json Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Host: 10.222.0.18 Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Openstack-System-Scope: None Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: User-Agent: python-urllib3/1.26.9 Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Auth-Token: gAAAAABitKK8Vbeot47SDriu1pK8dlQns4mjdWg02tghT6IYyM5UxVETLtMwVJ44jUqmBqRjDc3NFsRPS3MwAyNzGw9pAfwSx61tL7Tmjbk1O5RtPVxjvXIMjcCab1JAJPQ-ZPyF2TWaXvhgtggm3y7lKQ_QWJTzVhDf25r9wxebnisPEFbmEbM Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Id: None Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Domain-Name: None Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Identity-Status: Confirmed Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Is-Admin-Project: True Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Id: default Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Domain-Name: Default Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Id: 1bba540f52204efcb203231d7d780810 Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Project-Name: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Role: reader,member Jun 23 17:34:39.084018 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Roles: reader,member Jun 23 17:34:39.085784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1bba540f52204efcb203231d7d780810"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bba540f52204efcb203231d7d780810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1bba540f52204efcb203231d7d780810", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bba540f52204efcb203231d7d780810"}]}] Jun 23 17:34:39.085784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:39.085784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Id: 1bba540f52204efcb203231d7d780810 Jun 23 17:34:39.085784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-Tenant-Name: tempest-AttachVolumeTestJSON-418135206 Jun 23 17:34:39.085784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User: tempest-AttachVolumeTestJSON-418135206-project Jun 23 17:34:39.085784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Id: default Jun 23 17:34:39.085784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Domain-Name: Default Jun 23 17:34:39.085784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Id: 2fd5f4bd4834436bace14bcca9768658 Jun 23 17:34:39.085784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: X-User-Name: tempest-AttachVolumeTestJSON-418135206-project Jun 23 17:34:39.085784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: method: > Jun 23 17:34:39.085784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: exception: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:34:39.085784 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: action_args: {'id': '118fd6aa-e870-4729-a2e4-9a44e0a347b6'} Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: {{(pid=117897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 17:34:39.086897 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. Jun 23 17:34:39.088508 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: ERROR nova.api.openstack.wsgi Jun 23 17:34:39.090270 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: DEBUG nova.api.openstack.wsgi [None req-aafa5335-9de9-46f8-9a1c-1ba1f86aa83c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] Returning 404 to user: Instance 118fd6aa-e870-4729-a2e4-9a44e0a347b6 could not be found. {{(pid=117897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 17:34:39.090270 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO nova.api.openstack.requestlog [None req-aafa5335-9de9-46f8-9a1c-1ba1f86aa83c tempest-AttachVolumeTestJSON-418135206 tempest-AttachVolumeTestJSON-418135206-project] 10.222.0.18 "GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6" status: 404 len: 111 microversion: 2.1 time: 0.035762 Jun 23 17:34:39.090270 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: [pid: 117897|app: 0|req: 669/1317] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 23 17:34:39 2022] GET /compute/v2.1/servers/118fd6aa-e870-4729-a2e4-9a44e0a347b6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 17:35:14.547758 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:35:14.548384 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Thu Jun 23 17:35:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:35:28.733655 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:35:28.734294 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Thu Jun 23 17:35:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:37:03.890409 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:37:03.891194 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Thu Jun 23 17:37:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:37:09.241978 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:37:09.242940 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Thu Jun 23 17:37:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:37:26.465349 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:37:26.466336 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Thu Jun 23 17:37:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:38:34.558922 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:38:34.560509 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Thu Jun 23 17:38:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:38:48.742990 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:38:48.743657 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Thu Jun 23 17:38:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:39:38.386384 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:39:38.387290 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Thu Jun 23 17:39:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:40:23.901843 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:40:23.903005 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Thu Jun 23 17:40:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:40:29.252332 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:40:29.253498 dv-cinder-835384-10-iscsi devstack@n-api.service[117897]: Thu Jun 23 17:40:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 17:40:46.477635 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 17:40:46.478473 dv-cinder-835384-10-iscsi devstack@n-api.service[117896]: Thu Jun 23 17:40:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!